00000001:02000400:2.0F:1789575263.886923:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789575285.620807:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789575288.324353:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 655 MB/s 00000001:01000000:2.0:1789575288.575166:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 411 MB/s 00000001:01000000:2.0:1789575288.824564:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3075 MB/s 00000020:02000000:2.0:1789575289.662563:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gf14a6ef 00000400:02000000:2.0:1789575290.883462:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.132@tcp [8/256/0/180] 00008000:02000000:3.0:1789575295.117219:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789575353.758296:0:5265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789575369.462199:0:5842:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789575369.462207:0:5842:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789575369.462953:0:5842:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000088b493ac 00000080:02000400:2.0:1789575369.462969:0:5842:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789575369.472998:0:5842:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789575369.473012:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789575369.473415:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000019f9b24a) 00000020:00000080:3.0:1789575369.473990:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0F:1789575369.537759:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789575369.538935:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789575369.589254:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789575369.589310:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789575369.589333:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789575369.589945:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789575369.590040:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789575369.591195:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789575369.591204:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789575369.591226:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382e02 00000020:01000004:0.0:1789575369.591234:0:5842:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789575369.591239:0:5842:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789575369.591244:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000088b493ac from MGS 00000020:01000004:0.0:1789575369.591248:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789575369.591368:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f320f7c1) 00000020:00000080:0.0:1789575369.591738:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789575369.591845:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088b493ac from MGS, refs=2 00080000:01000000:0.0:1789575369.591851:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789575369.591856:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382e10 00000100:00100000:0.0:1789575369.592074:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789575369.592334:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789575369.592341:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789575369.594110:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789575369.594128:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789575369.597161:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575369.598067:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789575369.598074:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789575369.598897:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789575369.598903:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789575369.599341:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789575369.599349:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789575369.602124:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575369.602130:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575369.602132:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575369.603131:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575369.603135:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575369.603137:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575369.606151:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789575369.615828:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789575369.861498:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1848 MB/s 00000001:01000000:2.0:1789575370.111507:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2031 MB/s 00000001:01000000:1.0:1789575370.365939:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 377 MB/s 00000001:01000000:2.0:1789575370.618003:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 579 MB/s 00080000:10000000:2.0:1789575370.632247:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789575370.656580:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789575370.656602:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789575370.656605:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789575370.660018:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789575370.660111:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789575370.660171:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789575370.660554:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789575370.660584:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789575370.660987:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575370.661170:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789575370.661177:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1789575370.668901:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575370.672810:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789575370.675077:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789575370.677457:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789575370.677472:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789575370.682352:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789575370.682404:0:5842:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.132@tcp' 00000020:01000004:1.0:1789575370.682406:0:5842:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789575370.682466:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.132@tcp (typ=mgc) 00000020:00000080:1.0:1789575370.682498:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.132@tcp (000000006ba22136) 00000020:00000080:1.0:1789575370.682518:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789575370.682768:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000071bd1305@MGC192.168.202.132@tcp: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789575370.683025:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.132@tcp-0 is initialized 00000040:01000000:1.0:1789575370.683035:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789575370.687965:0:5859:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1789575370.690585:0:5858:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789575370.691130:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.132@tcp (uuid 30b00971-c2a0-490d-912f-6313f32cd11c) 00000020:00000080:0.0:1789575370.691156:0:5842:0:(genops.c:1384:class_connect()) connect: client 30b00971-c2a0-490d-912f-6313f32cd11c, cookie 0xc45cc82a22382e1e 00000100:00080000:0.0:1789575370.691171:0:5842:0:(import.c:545:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575370.691180:0:5842:0:(import.c:666:import_select_connection()) MGC192.168.202.132@tcp: import 0000000071bd1305 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575370.691231:0:5842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f60f429 x1876505699287168/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789575370.691259:0:5842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 30b00971-c2a0-490d-912f-6313f32cd11c->MGS 00000020:01000004:0.0:1789575370.691276:0:5842:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789575370.691282:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789575370.692233:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000088478154) 00000020:00000080:0.0:1789575370.692252:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789575370.693604:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f60f429 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699287168:0@lo:250: 00000100:00100000:2.0:1789575370.694809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575370.696227:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287168 00000100:00100000:3.0:1789575370.696250:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287168 00000100:00100000:3.0:1789575370.696339:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575370.696351:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091e39555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876505699287168:12345-0@lo:250: 00010000:00080000:3.0:1789575370.696438:0:5854:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 30b00971-c2a0-490d-912f-6313f32cd11c@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1789575370.696478:0:5854:0:(genops.c:1384:class_connect()) connect: client 30b00971-c2a0-490d-912f-6313f32cd11c, cookie 0xc45cc82a22382e2c 00000100:00080000:3.0:1789575370.698835:0:5854:0:(import.c:65:import_set_state_nolock()) 00000000d9431350 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575370.699304:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091e39555 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+5:3305:x1876505699287168:12345-0@lo:250: Request processed in 2951us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575370.699316:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575370.699454:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789575370.699464:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1789575370.699473:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789575370.699489:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789575370.699501:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000071bd1305 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789575370.699504:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789575370.699512:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789575370.699517:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f60f429 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699287168:0@lo:250: 00000100:00100000:1.0:1789575370.747064:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575370.747668:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789575370.747676:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789575370.748970:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789575370.748980:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789575370.750327:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789575370.750339:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789575370.751952:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575370.752187:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789575370.752194:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789575370.755345:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789575370.755357:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789575370.874460:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575370.874783:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789575370.874789:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789575370.876686:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789575370.876700:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789575370.882244:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575370.882515:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789575370.882522:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789575370.883706:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789575370.883714:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789575370.888573:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575370.888918:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789575370.888923:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789575370.889855:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789575370.889864:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789575370.890960:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575370.891183:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789575370.891199:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789575370.892760:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789575370.892772:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789575370.961081:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789575370.961334:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789575370.961342:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789575370.967328:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789575370.967499:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789575370.973109:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789575370.973137:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789575370.974472:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789575370.974499:0:5842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789575370.974505:0:5842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789575370.974675:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789575370.974779:0:5842:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789575370.974783:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789575370.974785:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789575370.974786:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575370.974787:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575370.974788:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575370.974790:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575370.974791:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789575370.974792:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789575370.974794:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789575370.974795:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789575370.974797:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575370.974798:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575370.974800:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789575370.974802:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575370.974803:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789575370.974805:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575370.974806:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575370.974807:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575370.974808:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575370.974809:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789575370.974810:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789575370.974811:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789575370.974812:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789575370.974818:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575370.974819:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575370.974882:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789575370.974907:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b44d97ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287296:0@lo:253: 00000100:00100000:3.0:1789575370.975008:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575370.975085:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d03dcb8d going to sleep for 11 seconds 00000100:00100000:0.0:1789575370.975548:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287296 00000100:00100000:0.0:1789575370.975560:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287296 00000100:00100000:0.0:1789575370.975618:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575370.975627:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc796a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+5:5842:x1876505699287296:12345-0@lo:253: 20000000:01000000:0.0:1789575370.975675:0:5857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789575370.975679:0:5857:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789575370.979613:0:5878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789575370.983768:0:5857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789575370.985583:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575370.987562:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789575370.990719:0:5857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789575370.990727:0:5857:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789575370.990736:0:5857:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789575370.990741:0:5857:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789575370.990772:0:5857:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789575370.991567:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575370.992649:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789575370.992674:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789575370.992736:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789575370.992789:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789575370.992891:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789575370.993034:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789575370.993058:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789575370.993289:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789575370.993298:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789575370.993335:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789575370.993343:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789575370.993582:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789575370.993637:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789575370.993677:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789575370.993684:0:5857:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789575370.993697:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575370.993987:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789575370.993999:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789575370.994031:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789575370.994077:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789575370.994215:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789575370.994228:0:5857:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789575370.994303:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789575370.994312:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789575370.999088:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789575370.999623:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789575370.999670:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789575370.999694:0:5857:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789575371.003093:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789575371.003141:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789575371.003695:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789575371.003739:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789575371.004255:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789575371.004306:0:5857:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789575371.004314:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789575371.005190:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789575371.005536:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789575371.005567:0:5857:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.132@tcp for mdt 20000000:01000000:0.0:1789575371.005580:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:0.0:1789575371.005621:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789575371.005631:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789575371.005662:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789575371.005670:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:0.0:1789575371.005716:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789575371.005727:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789575371.005758:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789575371.005794:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789575371.005923:0:5857:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789575371.005926:0:5857:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789575371.005930:0:5857:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789575371.005942:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789575371.005945:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789575371.005975:0:5857:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789575371.005977:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789575371.007605:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789575371.024296:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789575371.024361:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789575371.024445:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789575371.024467:0:5857:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789575371.024471:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789575371.029494:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789575371.030021:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789575371.030093:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789575371.030216:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1789575371.030233:0:5857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789575371.030235:0:5857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789575371.030241:0:5857:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789575371.030244:0:5857:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789575371.030250:0:5857:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789575371.030258:0:5857:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789575371.032473:0:5883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789575371.032732:0:5857:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789575371.044699:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789575371.044760:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789575371.044835:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789575371.044862:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789575371.044888:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044909:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044919:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044925:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044946:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044952:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044958:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000919b5533 already unused, calling callback (00000000337ee661) 00010000:00010000:1.0:1789575371.044962:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044971:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044986:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044994:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.044999:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000919b5533/0xc45cc82a22382e33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789575371.045021:0:5857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789575371.646238:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc796a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+5:5842:x1876505699287296:12345-0@lo:253: Request processed in 670604us (671221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575371.646424:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b44d97ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287296:0@lo:253: 10000000:01000000:0.0:1789575371.646626:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789575371.646630:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789575371.646653:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789575371.646655:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789575371.646656:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789575371.646657:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789575371.646658:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789575371.646659:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789575371.646661:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789575371.646663:0:5842:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789575371.646664:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789575371.646665:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789575371.646689:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000088b493ac from lustre-MDT0000 10000000:01000000:0.0:1789575371.646717:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789575371.646719:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789575371.646723:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e96879b99c0 10000000:01000000:0.0:1789575371.646728:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789575371.646736:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e96879b99c0 from 1 10000000:01000000:0.0:1789575371.646739:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789575371.646782:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575371.646793:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575371.646801:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575371.646817:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4432947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287424:0@lo:101: 00000100:00100000:0.0:1789575371.646856:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575371.646913:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078c3e9c7 going to sleep for 11 seconds 00000100:00100000:3.0:1789575371.646990:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575371.647025:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287424 00000100:00100000:3.0:1789575371.647030:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287424 00000100:00100000:3.0:1789575371.647071:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789575371.647078:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c1c65d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+5:5842:x1876505699287424:12345-0@lo:101: 00010000:00010000:3.0:1789575371.647091:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575371.647103:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d0a86f4/0xc45cc82a22382e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382e3a expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.647125:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d0a86f4/0xc45cc82a22382e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.647134:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d0a86f4/0xc45cc82a22382e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.647216:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d0a86f4, rc 0) 00000100:00100000:3.0:1789575371.647553:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c1c65d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+6:5842:x1876505699287424:12345-0@lo:101: Request processed in 474us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575371.647560:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789575371.647600:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4432947 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287424:0@lo:101: 00010000:00010000:3.0:1789575371.647616:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.647634:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575371.647685:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287552:0@lo:501: 00000100:00100000:3.0:1789575371.647724:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575371.647746:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e04b692a going to sleep for 11 seconds 00000100:00100000:3.0:1789575371.647758:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287552 00000100:00100000:3.0:1789575371.647762:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287552 00000100:00100000:3.0:1789575371.647779:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789575371.647785:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084ec2101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+6:5842:x1876505699287552:12345-0@lo:501: 00000100:00100000:3.0:1789575371.648028:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084ec2101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+6:5842:x1876505699287552:12345-0@lo:501: Request processed in 244us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575371.648047:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789575371.648078:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287552:0@lo:501: 10000000:01000000:3.0:1789575371.648105:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789575371.648119:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.648127:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000d6341639/0xc45cc82a22382e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575371.648135:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9689726000 10000000:01000000:3.0:1789575371.648151:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789575371.648157:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e9689726000 10000000:01000000:3.0:1789575371.648160:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789575371.648162:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e9689726000 from 1 10000000:01000000:3.0:1789575371.648170:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789575371.648187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.648194:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.648201:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575371.648213:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287680:0@lo:101: 00000100:00100000:3.0:1789575371.648237:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575371.648811:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287680 00000100:00100000:2.0:1789575371.648818:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287680 00000100:00100000:2.0:1789575371.648861:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575371.648867:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a13dae78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+6:5842:x1876505699287680:12345-0@lo:101: 00010000:00010000:2.0:1789575371.648877:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575371.648890:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002cce626d/0xc45cc82a22382e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382e48 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575371.648908:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002cce626d/0xc45cc82a22382e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382e48 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575371.648916:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002cce626d/0xc45cc82a22382e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382e48 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575371.648923:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002cce626d, rc 0) 00000100:00100000:2.0:1789575371.648953:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a13dae78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+7:5842:x1876505699287680:12345-0@lo:101: Request processed in 86us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575371.648959:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789575371.651688:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e04b692a going to sleep for 11 seconds 00000100:00100000:3.0:1789575371.651739:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287680:0@lo:101: 00010000:00010000:3.0:1789575371.651767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.651797:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575371.651823:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789575371.651827:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.651834:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000009f15fc71/0xc45cc82a22382e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575371.651841:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789575371.651852:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789575371.651859:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e9689726000 10000000:01000000:3.0:1789575371.651881:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789575371.651886:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789575371.651889:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789575371.651926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.651933:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.651941:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575371.651959:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287808:0@lo:101: 00000100:00100000:3.0:1789575371.652016:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575371.652066:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e04b692a going to sleep for 11 seconds 00000100:00100000:3.0:1789575371.652113:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287808 00000100:00100000:3.0:1789575371.652122:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287808 00000100:00100000:3.0:1789575371.652167:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789575371.652176:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b98bd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+7:5842:x1876505699287808:12345-0@lo:101: 00010000:00010000:3.0:1789575371.652190:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575371.652204:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059afb573/0xc45cc82a22382e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382e56 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.652225:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059afb573/0xc45cc82a22382e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.652234:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059afb573/0xc45cc82a22382e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 8 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575371.652242:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059afb573, rc 0) 00000100:00100000:3.0:1789575371.657881:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b98bd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+8:5842:x1876505699287808:12345-0@lo:101: Request processed in 5696us (5855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575371.657896:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575371.659453:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000715dd7f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287808:0@lo:101: 00010000:00010000:1.0:1789575371.659484:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575371.659496:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575371.659622:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287936:0@lo:501: 00000100:00100000:1.0:1789575371.659695:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575371.659764:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b06c67 going to sleep for 11 seconds 00000100:00100000:3.0:1789575371.662794:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699287936 00000100:00100000:3.0:1789575371.662820:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699287936 00000100:00100000:3.0:1789575371.662923:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789575371.662935:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093d18863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+8:5842:x1876505699287936:12345-0@lo:501: 00000100:00100000:2.0:1789575371.664074:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093d18863 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+9:5842:x1876505699287936:12345-0@lo:501: Request processed in 1136us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575371.664088:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575371.664285:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699287936:0@lo:501: 00000100:00100000:1.0:1789575371.664346:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288064:0@lo:503: 00000100:00100000:1.0:1789575371.664436:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575371.664490:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092b06c67 going to sleep for 11 seconds 00000100:00100000:2.0:1789575371.664588:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288064 00000100:00100000:2.0:1789575371.664595:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288064 00000100:00100000:2.0:1789575371.664624:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575371.664631:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a019704b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+9:5842:x1876505699288064:12345-0@lo:503: 00000100:00100000:2.0:1789575371.664815:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a019704b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+9:5842:x1876505699288064:12345-0@lo:503: Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575371.664823:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789575371.665130:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288064:0@lo:503: 00000100:00100000:1.0:1789575371.665702:0:5885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5885:1876505699288192:0@lo:502: 00000100:00100000:1.0:1789575371.665759:0:5885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575371.665789:0:5885:0:(client.c:2716:ptlrpc_set_wait()) set 00000000147c2362 going to sleep for 11 seconds 00000100:00100000:2.0:1789575371.666019:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288192 00000100:00100000:2.0:1789575371.666043:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288192 00000100:00100000:2.0:1789575371.666085:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575371.666094:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c84d213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+9:5885:x1876505699288192:12345-0@lo:502: 00000100:00100000:2.0:1789575371.666339:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c84d213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+9:5885:x1876505699288192:12345-0@lo:502: Request processed in 246us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575371.666347:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789575371.666850:0:5885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5885:1876505699288192:0@lo:502: 00000020:01000000:1.0:1789575371.666878:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575371.666889:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575371.666892:0:5885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789575371.666898:0:5885:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789575371.666901:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575371.666916:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000040fa85fd) 00000020:00000080:1.0:1789575371.666933:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789575371.666939:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789575371.667019:0:5885:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789575371.667047:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382e6b 00000020:00000080:1.0:1789575371.667597:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789575371.667603:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575371.667607:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575371.667614:0:5885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789575371.667617:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575371.667621:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575371.667622:0:5885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789575371.667625:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575371.667632:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000090ff69f1) 00000020:00000080:1.0:1789575371.667643:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789575371.667646:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789575371.667648:0:5885:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789575371.667651:0:5885:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789575371.667656:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789575371.667701:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088b493ac from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789575371.667711:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000003ba1b51) 00000020:00000080:1.0:1789575371.667728:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789575371.667772:0:5885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789575371.667777:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a22382e80 00000020:00000080:1.0:1789575371.667873:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789575371.667878:0:5885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789575371.667882:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc45cc82a22382e87 00080000:01000000:1.0:1789575371.667887:0:5885:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789575371.667890:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382e8e 00080000:10000000:1.0:1789575371.669749:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789575371.670047:0:5885:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789575371.689234:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1789575371.693740:0:5885:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789575371.931024:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789575371.933857:0:5885:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789575371.941947:0:5885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789575371.944065:0:5885:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789575372.067803:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000477022ce) 00000020:00000080:3.0:1789575372.067867:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789575372.067954:0:5885:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789575372.067963:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382e9c 00000020:00000080:2.0:1789575372.086081:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789575372.089100:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575372.267211:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575372.349744:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789575372.449290:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789575372.610503:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789575372.713715:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1789575372.715035:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789575372.793973:0:5885:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc45cc82a22382ea3 00000020:00000080:1.0:1789575372.794808:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789575372.794822:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575372.794834:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575372.794837:0:5885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789575372.794840:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575372.794844:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575372.794846:0:5885:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789575372.794849:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789575372.794851:0:5885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789575372.794853:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575372.794856:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575372.794858:0:5885:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789575372.794860:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575372.794864:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575372.794866:0:5885:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789575372.794871:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789575372.794911:0:5885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789575372.794965:0:5885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5885:1876505699288320:0@lo:502: 00000100:00100000:1.0:1789575372.795069:0:5885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575372.795150:0:5885:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083d27504 going to sleep for 11 seconds 00000100:00100000:3.0:1789575372.805287:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288320 00000100:00100000:3.0:1789575372.805312:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288320 00000100:00100000:3.0:1789575372.805474:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789575372.805484:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099e767f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+9:5885:x1876505699288320:12345-0@lo:502: 00000100:00100000:3.0:1789575372.805903:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099e767f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+9:5885:x1876505699288320:12345-0@lo:502: Request processed in 421us (10834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575372.805911:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789575372.806400:0:5885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da495b79 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5885:1876505699288320:0@lo:502: 00000020:01000000:1.0:1789575372.806445:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575372.806456:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575372.806459:0:5885:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789575372.806465:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789575372.807494:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789575372.807533:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789575372.807564:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.807579:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000b7c9ed2f/0xc45cc82a22382e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575372.807589:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e9689726000 from 1 10000000:01000000:3.0:1789575372.807613:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789575372.807664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.807674:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.807686:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575372.807716:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efabf58d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288448:0@lo:101: 00000100:00100000:3.0:1789575372.807806:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575372.807873:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f0702aa going to sleep for 11 seconds 00000100:00100000:1.0:1789575372.808180:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288448 00000100:00100000:1.0:1789575372.808192:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288448 00000100:00100000:1.0:1789575372.808250:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789575372.808261:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7c7f704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+9:5842:x1876505699288448:12345-0@lo:101: 00010000:00010000:1.0:1789575372.808276:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575372.808290:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382eaa expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.808332:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.808356:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.808365:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000919b5533, rc 0) 00000100:00100000:1.0:1789575372.808425:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7c7f704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+10:5842:x1876505699288448:12345-0@lo:101: Request processed in 166us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575372.808432:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789575372.808667:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efabf58d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288448:0@lo:101: 00010000:00010000:3.0:1789575372.808684:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.808695:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575372.809266:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efabf58d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288576:0@lo:256: 00000100:00100000:3.0:1789575372.809320:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575372.809518:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f0702aa going to sleep for 11 seconds 00000100:00100000:2.0:1789575372.810120:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288576 00000100:00100000:2.0:1789575372.810131:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288576 00000100:00100000:2.0:1789575372.811618:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789575372.811636:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004da7d8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+10:5842:x1876505699288576:12345-0@lo:256: 20000000:01000000:2.0:1789575372.811660:0:5856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789575372.811666:0:5856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789575372.811782:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004da7d8b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+10:5842:x1876505699288576:12345-0@lo:256: Request processed in 155us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575372.811790:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789575372.812510:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efabf58d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288576:0@lo:256: 10000000:01000000:0.0:1789575372.813073:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789575372.813112:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.813124:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575372.813134:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9689726000 from 1 10000000:01000000:0.0:1789575372.813137:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575372.815412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.815433:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.815446:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575372.815470:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288704:0@lo:101: 00000100:00100000:0.0:1789575372.815543:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575372.815603:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f1c957 going to sleep for 11 seconds 00000100:00100000:3.0:1789575372.817438:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288704 00000100:00100000:3.0:1789575372.817457:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288704 00000100:00100000:3.0:1789575372.817528:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789575372.817536:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008085860f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+10:5842:x1876505699288704:12345-0@lo:101: 00010000:00010000:3.0:1789575372.817555:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575372.817576:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382eb8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.817624:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.817636:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.817645:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046619ef8, rc 0) 00000100:00100000:3.0:1789575372.817723:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008085860f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699288704:12345-0@lo:101: Request processed in 188us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575372.817730:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789575372.818231:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288704:0@lo:101: 00010000:00010000:0.0:1789575372.818252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.818261:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575372.818329:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288832:0@lo:501: 00000100:00100000:0.0:1789575372.818398:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575372.818443:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f1c957 going to sleep for 11 seconds 00000100:00100000:3.0:1789575372.818689:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288832 00000100:00100000:3.0:1789575372.818695:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288832 00000100:00100000:3.0:1789575372.818728:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575372.818736:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034177bcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699288832:12345-0@lo:501: 00000100:00100000:3.0:1789575372.819301:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034177bcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699288832:12345-0@lo:501: Request processed in 566us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575372.819311:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789575372.819767:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288832:0@lo:501: 00000100:00100000:0.0:1789575372.819813:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288960:0@lo:503: 00000100:00100000:0.0:1789575372.819866:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575372.819905:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f1c957 going to sleep for 11 seconds 00000100:00100000:3.0:1789575372.820114:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699288960 00000100:00100000:3.0:1789575372.820120:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699288960 00000100:00100000:3.0:1789575372.820175:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789575372.820183:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb76fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699288960:12345-0@lo:503: 00000040:00080000:3.0:1789575372.820229:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575372.820280:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb76fcfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699288960:12345-0@lo:503: Request processed in 99us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575372.820288:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789575372.820840:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699288960:0@lo:503: 00000040:00080000:0.0:1789575372.821865:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789575372.822120:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789575372.822144:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575372.822169:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.822181:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575372.822231:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789575372.822234:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9689726000 10000000:01000000:2.0:1789575372.822245:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9689726000 10000000:01000000:2.0:1789575372.822249:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789575372.822254:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9689726000 from 1 10000000:01000000:2.0:1789575372.822257:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789575372.822306:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.822315:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.822324:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575372.822354:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289088:0@lo:101: 00000100:00100000:2.0:1789575372.822448:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.822483:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc7551bd going to sleep for 11 seconds 00000100:00100000:1.0:1789575372.822607:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289088 00000100:00100000:1.0:1789575372.822615:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289088 00000100:00100000:1.0:1789575372.822659:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575372.822667:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000097955995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699289088:12345-0@lo:101: 00010000:00010000:1.0:1789575372.822680:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575372.822692:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000618d6005/0xc45cc82a22382ecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382ec6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.822715:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000618d6005/0xc45cc82a22382ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.822725:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000618d6005/0xc45cc82a22382ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.822733:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000618d6005, rc 0) 00000100:00100000:1.0:1789575372.822780:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000097955995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289088:12345-0@lo:101: Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575372.822786:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789575372.823597:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289088:0@lo:101: 00010000:00010000:2.0:1789575372.823614:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.823623:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575372.823683:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289216:0@lo:501: 00000100:00100000:2.0:1789575372.823719:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.823759:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc7551bd going to sleep for 11 seconds 00000100:00100000:0.0:1789575372.823812:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289216 00000100:00100000:0.0:1789575372.823818:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289216 00000100:00100000:0.0:1789575372.823856:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789575372.823863:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e38d2407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289216:12345-0@lo:501: 00000100:00100000:0.0:1789575372.824137:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e38d2407 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289216:12345-0@lo:501: Request processed in 274us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575372.824144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789575372.824399:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289216:0@lo:501: 00000100:00100000:2.0:1789575372.824428:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289344:0@lo:503: 00000100:00100000:2.0:1789575372.824471:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.824487:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc7551bd going to sleep for 11 seconds 00000100:00100000:0.0:1789575372.824636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289344 00000100:00100000:0.0:1789575372.824641:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289344 00000100:00100000:0.0:1789575372.824739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575372.824747:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f670a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289344:12345-0@lo:503: 00000100:00100000:0.0:1789575372.825057:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f670a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289344:12345-0@lo:503: Request processed in 311us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575372.825065:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789575372.825137:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289344:0@lo:503: 00000100:00100000:2.0:1789575372.825391:0:5890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5890:1876505699289472:0@lo:502: 00000100:00100000:2.0:1789575372.825426:0:5890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.835274:0:5890:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edf59c4f going to sleep for 11 seconds 00000100:00100000:3.0:1789575372.843291:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289472 00000100:00100000:3.0:1789575372.843311:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289472 00000100:00100000:2.0:1789575372.843616:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789575372.843625:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5dd8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5890:x1876505699289472:12345-0@lo:502: 00000100:00100000:2.0:1789575372.844035:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5dd8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5890:x1876505699289472:12345-0@lo:502: Request processed in 410us (18609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575372.844044:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789575372.844537:0:5890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079a1867d pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5890:1876505699289472:0@lo:502: 00000020:01000004:3.0:1789575372.844618:0:5890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789575372.844638:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000109069a9) 00000020:00000080:3.0:1789575372.844658:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789575372.844740:0:5890:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000088b493ac from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789575372.844744:0:5890:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000088b493ac from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789575372.844746:0:5890:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000088b493ac 4 00010000:00080000:3.0:1789575372.844771:0:5890:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008a66b8c3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789575372.856767:0:5890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789575372.857035:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789575372.857077:0:5890:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789575372.857107:0:5890:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc45cc82a22382edb 00000100:00080000:2.0:1789575372.857120:0:5890:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789575372.857133:0:5890:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008a66b8c3 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575372.857196:0:5890:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db7c8281 x1876505699289600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789575372.857268:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db7c8281 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699289600:0@lo:38: 00000100:00100000:3.0:1789575372.857360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575372.857507:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289600 00000100:00100000:1.0:1789575372.857519:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289600 00000100:00100000:1.0:1789575372.857559:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575372.857566:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc50e925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699289600:12345-0@lo:38: 00000100:00080000:2.0:1789575372.858531:0:5890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789575372.859640:0:5890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5890:1876505699289728:0@lo:502: 00000100:00100000:2.0:1789575372.859724:0:5890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.859761:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289728 00000100:00100000:2.0:1789575372.859767:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289728 00000100:00100000:2.0:1789575372.859809:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789575372.859816:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000030f448f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5890:x1876505699289728:12345-0@lo:502: 00000100:00100000:2.0:1789575372.860088:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000030f448f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5890:x1876505699289728:12345-0@lo:502: Request processed in 272us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575372.860096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789575372.860145:0:5890:0:(client.c:2716:ptlrpc_set_wait()) set 000000002759d5ff going to sleep for 11 seconds 00000100:00100000:2.0:1789575372.866147:0:5890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:5890:1876505699289728:0@lo:502: 00000040:00080000:2.0:1789575372.866236:0:5890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789575372.866387:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789575372.866409:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789575372.866428:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.866440:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 0000000062ad7aed/0xc45cc82a22382ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789575372.866494:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789575372.866497:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789575372.866498:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575372.866500:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575372.866501:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575372.866502:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575372.866503:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789575372.866505:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789575372.866506:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575372.866508:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575372.866509:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575372.866511:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575372.866514:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789575372.866517:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789575372.866518:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789575372.866519:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575372.866520:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575372.866521:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575372.866522:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575372.866528:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789575372.866529:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789575372.866530:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575372.866531:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575372.866534:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575372.866535:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575372.866563:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789575372.866580:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289856:0@lo:253: 00000100:00100000:2.0:1789575372.866650:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575372.866677:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000002759d5ff going to sleep for 11 seconds 00000100:00100000:2.0:1789575372.866776:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289856 00000100:00100000:2.0:1789575372.866784:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289856 00000100:00100000:2.0:1789575372.866840:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789575372.866850:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b586ab94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5842:x1876505699289856:12345-0@lo:253: 20000000:01000000:2.0:1789575372.866884:0:5856:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789575372.866900:0:5856:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789575372.877978:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc50e925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699289600:12345-0@lo:38: Request processed in 20393us (20601us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789575372.878006:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575372.879501:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789575372.879513:0:3305:0:(import.c:65:import_set_state_nolock()) 000000008a66b8c3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789575372.879520:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789575372.879523:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db7c8281 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699289600:0@lo:38: 20000000:01000000:1.0:1789575372.969655:0:5856:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789575372.969713:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789575372.978712:0:5878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789575372.978724:0:5878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789575372.978896:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.978915:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.978923:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.978968:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575372.978984:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 12 pid: 5857 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575372.979016:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b79231c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699289984:0@lo:104: 00000100:00100000:3.0:1789575372.979114:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575372.979210:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set 000000006991d838 going to sleep for 11 seconds 00000100:00100000:2.0:1789575372.981546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699289984 00000100:00100000:2.0:1789575372.981563:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699289984 00000100:00100000:2.0:1789575372.981612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789575372.981620:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000159e78ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699289984:12345-0@lo:104: 00010000:00010000:2.0:1789575372.981637:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575372.981741:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575372.981746:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000159e78ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699289984:12345-0@lo:104: Request processed in 127us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575372.981753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575372.981836:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b79231c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699289984:0@lo:104: 00010000:00010000:1.0:1789575372.981866:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.981920:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575372.981926:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.981950:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ebc75a81 already unused, calling callback (000000009c387db0) 10000000:00010000:0.0:1789575372.981954:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.981961:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575372.981967:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575372.981972:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789575372.982020:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.982034:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575372.982058:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.982064:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000ebc75a81/0xc45cc82a22382eaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.982088:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575372.982090:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575372.982092:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575372.982251:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699290112:0@lo:103: 00000100:00100000:1.0:1789575372.982306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575372.991992:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290112 00000100:00100000:0.0:1789575372.992011:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290112 00010000:00010000:0.0:1789575372.992062:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 13 pid: 5857 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575372.992107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575372.992133:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da495b79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+13:3307:x1876505699290112:12345-0@lo:103: 00010000:00010000:0.0:1789575372.992162:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575372.992179:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 13 pid: 5857 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992192:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 13 pid: 5857 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992210:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000919b5533/0xc45cc82a22382eb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382eaa expref: 13 pid: 5857 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992227:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992236:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789575372.992253:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013530075s 00010000:00010000:0.0:1789575372.992257:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992263:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992269:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992275:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992281:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afcbe342 already unused, calling callback (00000000337ee661) 00010000:00010000:0.0:1789575372.992300:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992309:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992334:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575372.992352:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575372.992463:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da495b79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+12:3307:x1876505699290112:12345-0@lo:103: Request processed in 332us (10157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575372.992471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789575372.992706:0:5878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.992715:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575372.992721:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afcbe342/0xc45cc82a22382ee2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575372.992764:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c818160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699290112:0@lo:103: 00000100:00100000:1.0:1789575372.996706:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b586ab94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+11:5842:x1876505699289856:12345-0@lo:253: Request processed in 129849us (130047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575372.996723:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789575372.996981:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:5842:1876505699289856:0@lo:253: 10000000:01000000:2.0:1789575372.997001:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789575372.997004:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575372.997018:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789575372.997019:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575372.997032:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575372.997033:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575372.997035:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575372.997036:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789575372.997039:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789575372.997040:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575372.997042:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575372.997043:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575372.997045:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789575372.997060:0:5842:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789575373.008139:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.008590:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575373.008812:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.009009:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575373.009210:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.009409:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575373.014064:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.014729:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575373.014974:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.015627:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575373.015905:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575373.016108:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789575373.160747:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789575373.284718:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789575373.285088:0:5895:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789575373.285094:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789575373.285440:0:5896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789575373.288956:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789575373.289691:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789575373.297780:0:5842:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789575373.297808:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789575373.298134:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575373.299780:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789575373.300730:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789575373.300774:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789575373.301125:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789575373.306841:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789575373.326504:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789575373.326720:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789575373.328815:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789575373.328997:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789575373.329181:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789575373.329330:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789575373.329566:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789575373.329707:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789575373.329866:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789575373.330038:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789575373.330185:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789575373.330344:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789575373.330534:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789575373.330670:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789575373.330804:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789575373.330940:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789575373.348330:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789575373.348624:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789575373.348796:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789575373.348930:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789575373.349098:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789575373.349260:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789575373.349454:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789575373.349614:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789575373.349798:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789575373.349948:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789575373.350122:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789575373.350267:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789575373.350473:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789575373.350639:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789575373.350802:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789575373.350944:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789575373.362682:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789575373.409679:0:5896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789575373.544904:0:5842:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789575373.544945:0:5842:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6d3819a3988 00100000:10000000:1.0:1789575373.544954:0:5842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789575373.545973:0:5842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789575373.545993:0:5842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789575373.546007:0:5842:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789575373.546037:0:5842:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789575373.693532:0:5896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789575373.693612:0:5896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789575373.693617:0:5896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789575373.746469:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575374.764677:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575375.785748:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575376.825153:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575377.832635:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789575378.347454:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789575378.347497:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e9689726000 from 3 10000000:01000000:2.0:1789575378.347505:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789575378.347578:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575378.347594:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575378.347610:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575378.347647:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699290240:0@lo:101: 00000100:00100000:2.0:1789575378.347758:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575378.347852:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ffec02e going to sleep for 11 seconds 00000100:00100000:3.0:1789575378.348483:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290240 00000100:00100000:3.0:1789575378.348498:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290240 00000100:00100000:3.0:1789575378.348577:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789575378.348588:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bf3783d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+11:5859:x1876505699290240:12345-0@lo:101: 00010000:00010000:3.0:1789575378.348609:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575378.348628:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c173341/0xc45cc82a22382ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382ee9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575378.348684:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c173341/0xc45cc82a22382ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575378.348697:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c173341/0xc45cc82a22382ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575378.348713:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c173341, rc 0) 00000100:00100000:3.0:1789575378.348769:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bf3783d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699290240:12345-0@lo:101: Request processed in 182us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575378.348775:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789575378.348835:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000568e320a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699290240:0@lo:101: 00010000:00010000:3.0:1789575378.348855:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575378.348863:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575378.348934:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699290368:0@lo:256: 00000100:00100000:3.0:1789575378.348983:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575378.349015:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e68e364d going to sleep for 11 seconds 00000100:00100000:2.0:1789575378.349859:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290368 00000100:00100000:2.0:1789575378.349869:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290368 00000100:00100000:2.0:1789575378.349930:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789575378.349939:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000028561b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699290368:12345-0@lo:256: 20000000:01000000:2.0:1789575378.349964:0:5857:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789575378.350002:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789575378.350005:0:5857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789575378.350110:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000028561b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699290368:12345-0@lo:256: Request processed in 172us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575378.350119:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789575378.350240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789575378.350246:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789575378.350250:0:8:0:(import.c:65:import_set_state_nolock()) 000000008a66b8c3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789575378.350263:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008a66b8c3 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789575378.350315:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d6b623fb x1876505699290496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789575378.350574:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d6b623fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699290496:0@lo:38: 00000100:00100000:2.0:1789575378.350678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575378.350839:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699290368:0@lo:256: 10000000:01000000:3.0:1789575378.350906:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789575378.350920:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575378.350931:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000001856cfbf/0xc45cc82a22382ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575378.351028:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290496 00000100:00100000:1.0:1789575378.351036:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290496 00000100:00100000:1.0:1789575378.351078:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575378.351084:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b782a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876505699290496:12345-0@lo:38: 00010000:00080000:1.0:1789575378.351110:0:5864:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1789575378.351157:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc45cc82a22382ef7 00000004:00100000:1.0:1789575378.351238:0:5864:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789575378.351652:0:5864:0:(import.c:65:import_set_state_nolock()) 000000002affb3a5 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575378.351751:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b782a54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876505699290496:12345-0@lo:38: Request processed in 665us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575378.351759:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789575378.351924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d6b623fb x1876505699290496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789575378.351942:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789575378.351955:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789575378.351963:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789575378.351966:0:3305:0:(import.c:65:import_set_state_nolock()) 000000008a66b8c3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789575378.352003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d6b623fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699290496:0@lo:38: 00010000:00010000:0.0:1789575378.876618:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789575379.852981:0:6139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789575379.885809:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575380.904651:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575381.930493:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575382.952974:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575383.464605:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a48555e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699290752:0@lo:400: 00000100:00100000:0.0:1789575383.464606:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d75b16b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699290624:0@lo:400: 00000100:00100000:2.0:1789575383.464683:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575383.464683:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575383.464773:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290624 00000100:00100000:1.0:1789575383.464785:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290624 00000100:00100000:1.0:1789575383.464856:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789575383.464865:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000528e6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:3308:x1876505699290624:12345-0@lo:400: 00000100:00100000:1.0:1789575383.464939:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000528e6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:3308:x1876505699290624:12345-0@lo:400: Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575383.464946:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575383.465127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d75b16b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699290624:0@lo:400: 00000100:00100000:3.0:1789575383.472517:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290752 00000100:00100000:3.0:1789575383.472536:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290752 00000100:00100000:3.0:1789575383.472612:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575383.472623:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002bfc6b29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699290752:12345-0@lo:400: 00000100:00100000:3.0:1789575383.472753:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002bfc6b29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699290752:12345-0@lo:400: Request processed in 132us (8068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575383.472761:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789575383.472975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001a48555e x1876505699290752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575383.472994:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a48555e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699290752:0@lo:400: 00010000:00010000:3.0:1789575383.977993:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575385.001496:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789575385.541627:0:6341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9788f8b0 20000000:00000080:2.0:1789575385.541645:0:6341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96bb8b4800 uarg=0000000000000000 20000000:01000000:2.0:1789575385.541685:0:6341:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789575385.541692:0:6341:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789575385.541697:0:6341:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789575385.541880:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789575385.541892:0:6341:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789575385.549086:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575385.557954:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789575385.558085:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789575385.558705:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789575385.558838:0:6341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789575385.558857:0:6341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575385.558877:0:6341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575385.558885:0:6341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575385.558943:0:6341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575385.558961:0:6341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 11 pid: 5856 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575385.558976:0:6341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002875a126 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1876505699290880:0@lo:104: 00000100:00100000:2.0:1789575385.559040:0:6341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575385.559103:0:6341:0:(client.c:2716:ptlrpc_set_wait()) set 00000000725b6d3d going to sleep for 11 seconds 00000100:00100000:3.0:1789575385.559109:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699290880 00000100:00100000:3.0:1789575385.559120:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699290880 00000100:00100000:3.0:1789575385.559182:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575385.559193:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000793259b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:6341:x1876505699290880:12345-0@lo:104: 00010000:00010000:3.0:1789575385.559206:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575385.559283:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575385.559289:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000793259b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:6341:x1876505699290880:12345-0@lo:104: Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575385.559315:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789575385.559513:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575385.559520:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.559529:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b6870dd4 already unused, calling callback (000000009c387db0) 10000000:00010000:0.0:1789575385.559531:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.559539:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575385.559546:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575385.559552:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789575385.559586:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.559593:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789575385.559638:0:6341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002875a126 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1876505699290880:0@lo:104: 00010000:00010000:2.0:1789575385.559657:0:6341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.559750:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575385.559768:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e7aa00b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699291008:0@lo:103: 00010000:00010000:0.0:1789575385.559771:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000b6870dd4/0xc45cc82a22382eb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.559795:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575385.559798:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575385.559799:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575385.559810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575385.559852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291008 00000100:00100000:0.0:1789575385.559943:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291008 00010000:00010000:0.0:1789575385.559968:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 12 pid: 5856 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575385.560004:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575385.560011:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000068106dc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+12:3306:x1876505699291008:12345-0@lo:103: 00010000:00010000:0.0:1789575385.560023:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575385.560028:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 12 pid: 5856 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560038:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 12 pid: 5856 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560050:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046619ef8/0xc45cc82a22382ebf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382eb8 expref: 12 pid: 5856 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560065:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560073:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560100:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560107:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560113:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560119:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560125:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f22228f9 already unused, calling callback (00000000337ee661) 00010000:00010000:0.0:1789575385.560128:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560135:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560150:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575385.560159:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575385.560187:0:6341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575385.560197:0:6341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575385.560204:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000068106dc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+11:3306:x1876505699291008:12345-0@lo:103: Request processed in 192us (393us total) trans 0 rc 0/0 00010000:00010000:2.0:1789575385.560205:0:6341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f22228f9/0xc45cc82a22382efe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575385.560228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575385.560404:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e7aa00b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699291008:0@lo:103: 00010000:00010000:0.0:1789575386.024593:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575387.048687:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575388.079058:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789575388.264505:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789575388.264515:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9689726000 from 1 10000000:01000000:3.0:1789575388.264520:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575388.264587:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000afcbe342/0xc45cc82a22382f05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575388.264602:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000afcbe342/0xc45cc82a22382f05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575388.264615:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000afcbe342/0xc45cc82a22382f05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575388.264645:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291136:0@lo:101: 00000100:00100000:3.0:1789575388.264722:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.264812:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0db61e going to sleep for 11 seconds 00000100:00100000:2.0:1789575388.265292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291136 00000100:00100000:2.0:1789575388.265303:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291136 00000100:00100000:2.0:1789575388.265367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789575388.265409:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026b2d588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+11:5859:x1876505699291136:12345-0@lo:101: 00010000:00010000:2.0:1789575388.265426:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575388.265444:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f22228f9/0xc45cc82a22382f0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f05 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575388.265474:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f22228f9/0xc45cc82a22382f0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575388.265487:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f22228f9/0xc45cc82a22382f0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575388.265496:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f22228f9, rc 0) 00000100:00100000:2.0:1789575388.265547:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026b2d588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699291136:12345-0@lo:101: Request processed in 140us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575388.265553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789575388.265764:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291136:0@lo:101: 00010000:00010000:3.0:1789575388.265796:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000afcbe342/0xc45cc82a22382f05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575388.265807:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000afcbe342/0xc45cc82a22382f05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575388.265894:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291264:0@lo:501: 00000100:00100000:3.0:1789575388.265926:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.265969:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0db61e going to sleep for 11 seconds 00000100:00100000:0.0:1789575388.266029:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291264 00000100:00100000:0.0:1789575388.266035:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291264 00000100:00100000:0.0:1789575388.266094:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789575388.266100:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f5e8c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699291264:12345-0@lo:501: 00000100:00100000:0.0:1789575388.266525:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f5e8c8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699291264:12345-0@lo:501: Request processed in 424us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575388.266534:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575388.267077:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291264:0@lo:501: 00000100:00100000:3.0:1789575388.267121:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291392:0@lo:503: 00000100:00100000:3.0:1789575388.267172:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.267214:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de0db61e going to sleep for 11 seconds 00000100:00100000:0.0:1789575388.267893:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291392 00000100:00100000:0.0:1789575388.267903:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291392 00000100:00100000:0.0:1789575388.267968:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789575388.267978:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005138ee8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699291392:12345-0@lo:503: 00000100:00100000:0.0:1789575388.268242:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005138ee8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699291392:12345-0@lo:503: Request processed in 264us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575388.268263:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789575388.268648:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699291392:0@lo:503: 00000100:00100000:3.0:1789575388.270915:0:6408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6408:1876505699291520:0@lo:502: 00000100:00100000:3.0:1789575388.271031:0:6408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.271100:0:6408:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078c3e9c7 going to sleep for 11 seconds 00000100:00100000:0.0:1789575388.271913:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291520 00000100:00100000:0.0:1789575388.271926:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291520 00000100:00100000:0.0:1789575388.271988:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789575388.271997:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000819c7afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6408:x1876505699291520:12345-0@lo:502: 00000100:00100000:0.0:1789575388.272233:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000819c7afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6408:x1876505699291520:12345-0@lo:502: Request processed in 237us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575388.272241:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789575388.272352:0:6408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f077bfb pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6408:1876505699291520:0@lo:502: 00000020:01000000:3.0:1789575388.272718:0:6408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575388.272729:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575388.272731:0:6408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789575388.272738:0:6408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9689726000 00000020:00000080:3.0:1789575388.272741:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789575388.272808:0:6408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6408:1876505699291648:0@lo:502: 00000100:00100000:3.0:1789575388.272850:0:6408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.272987:0:6408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575388.274745:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291648 00000100:00100000:0.0:1789575388.274762:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291648 00000100:00100000:1.0:1789575388.275564:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789575388.275581:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6408:x1876505699291648:12345-0@lo:502: 00000100:00100000:1.0:1789575388.276201:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6408:x1876505699291648:12345-0@lo:502: Request processed in 624us (3348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575388.276210:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789575388.276308:0:6408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6408:1876505699291648:0@lo:502: 00000020:01000000:3.0:1789575388.276353:0:6408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575388.276362:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575388.276365:0:6408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789575388.276401:0:6408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789575388.276590:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789575388.276610:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789575388.276621:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575388.276634:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575388.584533:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575388.584556:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699291776:0@lo:400: 00000100:00100000:0.0:1789575388.584616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575388.585186:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291776 00000100:00100000:3.0:1789575388.585196:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291776 00000100:00100000:3.0:1789575388.585243:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575388.585253:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699291776:12345-0@lo:400: 00000100:00100000:3.0:1789575388.585316:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699291776:12345-0@lo:400: Request processed in 64us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575388.585322:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789575388.585367:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e96bb210700 x1876505699291776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575388.585401:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699291776:0@lo:400: 00010000:00010000:2.0:1789575389.097488:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575390.121078:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575391.152936:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575392.168741:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575393.195460:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575393.707087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699292032:0@lo:400: 00000100:00100000:1.0:1789575393.707196:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575393.707279:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575393.707286:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699291904:0@lo:400: 00000100:00100000:1.0:1789575393.707327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575393.707403:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699291904 00000100:00100000:1.0:1789575393.707415:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699291904 00000100:00100000:1.0:1789575393.707492:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575393.707504:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699291904:12345-0@lo:400: 00000100:00100000:1.0:1789575393.707568:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699291904:12345-0@lo:400: Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575393.707576:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575393.707636:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699291904:0@lo:400: 00000100:00100000:2.0:1789575393.707928:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292032 00000100:00100000:2.0:1789575393.707934:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292032 00000100:00100000:2.0:1789575393.707979:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789575393.707987:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699292032:12345-0@lo:400: 00000100:00100000:2.0:1789575393.708035:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699292032:12345-0@lo:400: Request processed in 49us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575393.708042:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789575393.710437:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e9686982300 x1876505699292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575393.710661:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699292032:0@lo:400: 00000020:01000004:1.0:1789575393.896119:0:6704:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789575393.896127:0:6704:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789575393.897884:0:6704:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e9683db2800 00000020:01000004:1.0:1789575393.897921:0:6704:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789575393.897941:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789575393.897978:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e9699e619c0) 00000020:00000080:1.0:1789575393.898003:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789575393.979267:0:6704:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789575393.979742:0:6704:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789575394.050694:0:6704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789575394.059149:0:6704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789575394.059186:0:6704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789575394.059249:0:6704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789575394.059275:0:6704:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789575394.059646:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789575394.059661:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789575394.059674:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc45cc82a22382f1a 00000020:01000004:0.0:1789575394.059685:0:6704:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789575394.059713:0:6704:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789575394.059718:0:6704:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789575394.059724:0:6704:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789575394.059729:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789575394.059745:0:6704:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e9690ba8000) 00000020:00000080:0.0:1789575394.059756:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789575394.070847:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575394.071029:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789575394.071035:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789575394.091089:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789575394.091106:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789575394.091609:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789575394.091617:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789575394.095493:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575394.095685:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789575394.095692:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789575394.098237:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789575394.098250:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789575394.145477:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575394.145785:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789575394.145794:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789575394.149595:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789575394.149611:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789575394.150844:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789575394.150859:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789575394.154167:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575394.154476:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789575394.154483:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789575394.156701:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789575394.156720:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1789575394.216805:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575394.217249:0:6704:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575394.217611:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789575394.217699:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789575394.220359:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789575394.220402:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789575394.221281:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789575394.221307:0:6704:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789575394.221314:0:6704:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789575394.249920:0:6704:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789575394.249971:0:6704:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789575394.249976:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789575394.249978:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.249980:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.249984:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575394.249985:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.249987:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.249988:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.249990:0:6704:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575394.249991:0:6704:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575394.249993:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.249994:0:6704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789575394.249997:0:6704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789575394.249999:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789575394.250001:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.250001:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.250002:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575394.250003:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.250004:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.250005:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.250005:0:6704:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575394.250006:0:6704:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575394.250007:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.250008:0:6704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789575394.250042:0:6704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789575394.250069:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699292160:0@lo:253: 00000100:00100000:2.0:1789575394.250168:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575394.250420:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789575394.250499:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292160 00000100:00100000:0.0:1789575394.250508:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292160 00000100:00100000:0.0:1789575394.250598:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789575394.250608:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699292160:12345-0@lo:253: 20000000:01000000:0.0:1789575394.250646:0:5857:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789575394.250650:0:5857:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789575394.250656:0:5857:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789575394.250660:0:5857:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789575394.252144:0:5857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575394.252893:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789575394.252911:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789575394.252974:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789575394.252983:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789575394.253017:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789575394.253067:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789575394.253702:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789575394.253728:0:5857:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:0.0:1789575394.253731:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:0.0:1789575394.253769:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789575394.253777:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789575394.253839:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789575394.253848:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:0.0:1789575394.253882:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789575394.253892:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789575394.253920:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789575394.253982:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789575394.258360:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789575394.258536:0:5857:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:2.0:1789575394.258539:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789575394.258597:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789575394.258606:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789575394.258639:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789575394.258647:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:2.0:1789575394.258695:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789575394.258706:0:5857:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789575394.258739:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789575394.258776:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789575394.258795:0:5857:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789575394.258804:0:5857:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789575394.258809:0:5857:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789575394.258822:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789575394.258961:0:5857:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789575394.259003:0:5857:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789575394.259005:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789575394.259816:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789575394.260612:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789575394.260662:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789575394.260744:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789575394.260759:0:5857:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789575394.260761:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789575394.263822:0:6720:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789575394.263940:0:6720:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789575394.264005:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789575394.264497:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789575394.264546:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789575394.264585:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789575394.264597:0:5857:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789575394.264600:0:5857:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789575394.265746:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789575394.265816:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789575394.265892:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789575394.266333:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789575394.266490:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789575394.266554:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789575394.266570:0:5857:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789575394.266573:0:5857:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789575394.266581:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789575394.266601:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266619:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266627:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266635:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266658:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266696:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266711:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 12 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575394.266725:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292288:0@lo:104: 00000100:00100000:2.0:1789575394.266784:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575394.266883:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.266891:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 12 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575394.266899:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292416:0@lo:104: 00000100:00100000:2.0:1789575394.266918:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575394.267870:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.267886:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 12 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575394.267898:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292544:0@lo:104: 00000100:00100000:2.0:1789575394.267931:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.268116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292288 00000100:00100000:1.0:1789575394.268126:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292288 00000100:00100000:1.0:1789575394.268190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292416 00000100:00100000:1.0:1789575394.268194:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292416 00000100:00100000:1.0:1789575394.268213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575394.268223:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:5857:x1876505699292288:12345-0@lo:104: 00010000:00010000:1.0:1789575394.268257:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.270283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292544 00000100:00100000:3.0:1789575394.270296:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292544 00010000:00010000:1.0:1789575394.273532:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789575394.273565:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+5:5857:x1876505699292288:12345-0@lo:104: Request processed in 5334us (6771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.273580:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575394.273639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575394.273659:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:5857:x1876505699292416:12345-0@lo:104: 00010000:00010000:1.0:1789575394.273682:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.273751:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789575394.273756:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:5857:x1876505699292416:12345-0@lo:104: Request processed in 110us (6837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.273762:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575394.273777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789575394.273784:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5857:x1876505699292544:12345-0@lo:104: 00010000:00010000:1.0:1789575394.273793:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.273823:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789575394.273842:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5857:x1876505699292544:12345-0@lo:104: Request processed in 59us (5911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.273847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789575394.273945:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789575394.273954:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.273963:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575394.273969:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.273980:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575394.273997:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.274004:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575394.274075:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274082:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575394.274108:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274116:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2077a00/0xc45cc82a22382ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274136:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575394.274140:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274146:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575394.274176:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274184:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575394.274190:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.274196:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575394.274212:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274219:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575394.274225:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274231:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382e56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e5d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274240:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575394.274242:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274248:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575394.274251:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274257:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575394.274288:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.274294:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575394.274307:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274313:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575394.274332:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274339:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680031800/0xc45cc82a22382e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382e41 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.274355:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575394.274357:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575394.274358:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575394.274414:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699292800:0@lo:103: 00000100:00100000:3.0:1789575394.274466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575394.274658:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.274695:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292288:0@lo:104: 00000100:00100000:2.0:1789575394.274719:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292416:0@lo:104: 00000100:00100000:2.0:1789575394.274727:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5857:1876505699292544:0@lo:104: 00010000:00010000:2.0:1789575394.274756:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575394.275221:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789575394.275234:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699292928:0@lo:103: 00000100:00100000:2.0:1789575394.275328:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789575394.275489:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575394.275501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699292672:0@lo:103: 00000100:00100000:0.0:1789575394.275529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.275819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292800 00000100:00100000:1.0:1789575394.275836:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292800 00010000:00010000:1.0:1789575394.275875:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 13 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575394.275897:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292928 00000100:00100000:1.0:1789575394.275901:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292928 00010000:00010000:1.0:1789575394.275914:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 14 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575394.275924:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699292672 00000100:00100000:1.0:1789575394.275926:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699292672 00010000:00010000:1.0:1789575394.275935:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 15 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575394.275947:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575394.275954:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+15:3307:x1876505699292800:12345-0@lo:103: 00010000:00010000:1.0:1789575394.275987:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575394.276008:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 15 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276017:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 15 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276048:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2157200/0xc45cc82a22382e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382e56 expref: 15 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276062:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575394.276111:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+14:3307:x1876505699292800:12345-0@lo:103: Request processed in 157us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.276118:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575394.276136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575394.276143:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+13:3309:x1876505699292928:12345-0@lo:103: 00010000:00010000:1.0:1789575394.276156:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575394.276160:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 13 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276168:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 13 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276178:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2157a00/0xc45cc82a22382e41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382e3a expref: 13 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276187:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575394.276218:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699292928:12345-0@lo:103: Request processed in 76us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.276224:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575394.276237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789575394.276243:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+11:3306:x1876505699292672:12345-0@lo:103: 00010000:00010000:1.0:1789575394.276251:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575394.276256:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 11 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.276406:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699292800:0@lo:103: 00010000:00010000:1.0:1789575394.276574:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 11 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382ecd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382ec6 expref: 11 pid: 5857 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276597:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276606:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276628:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276636:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276642:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276648:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276654:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575394.276658:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276667:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.276704:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575394.276740:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+10:3306:x1876505699292672:12345-0@lo:103: Request processed in 497us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.276746:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789575394.276804:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.276814:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.276821:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076a00/0xc45cc82a22382f28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789575394.276860:0:5857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789575394.277573:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699292928:0@lo:103: 00000100:00100000:0.0:1789575394.279049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699292672:0@lo:103: 00000100:00100000:3.0:1789575394.322935:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+9:6704:x1876505699292160:12345-0@lo:253: Request processed in 72319us (72757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.322952:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575394.323064:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699292160:0@lo:253: 10000000:01000000:2.0:1789575394.323079:0:6704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789575394.323083:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575394.323085:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.323086:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.323088:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789575394.323089:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.323090:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.323091:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.323093:0:6704:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789575394.323094:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.323095:0:6704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789575394.323114:0:6704:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9683db2800 from lustre-OST0000 10000000:01000000:2.0:1789575394.323139:0:6704:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789575394.323142:0:6704:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789575394.323214:0:6704:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e96879b99c0 local copy 10000000:01000000:2.0:1789575394.323218:0:6704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789575394.323257:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.323269:0:6704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.323279:0:6704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575394.323310:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293056:0@lo:101: 00000100:00100000:2.0:1789575394.323348:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575394.323427:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789575394.323487:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293056 00000100:00100000:1.0:1789575394.323495:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293056 00000100:00100000:1.0:1789575394.323536:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789575394.323545:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+9:6704:x1876505699293056:12345-0@lo:101: 00010000:00010000:1.0:1789575394.323566:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575394.323580:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f2f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.323606:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f2f expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.323617:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f2f expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.323627:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1800, rc 0) 00000100:00100000:1.0:1789575394.323670:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+10:6704:x1876505699293056:12345-0@lo:101: Request processed in 127us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.323676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789575394.323838:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293056:0@lo:101: 00010000:00010000:3.0:1789575394.323852:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.323861:0:6704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.323956:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293184:0@lo:501: 00000100:00100000:3.0:1789575394.323981:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.324040:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575394.324079:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293184 00000100:00100000:0.0:1789575394.324089:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293184 00000100:00100000:0.0:1789575394.324122:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789575394.324128:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+10:6704:x1876505699293184:12345-0@lo:501: 00000100:00100000:2.0:1789575394.324613:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+10:6704:x1876505699293184:12345-0@lo:501: Request processed in 483us (629us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789575394.324621:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789575394.325434:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293184:0@lo:501: 10000000:01000000:3.0:1789575394.325456:0:6704:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789575394.325499:0:6704:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789575394.325507:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.325517:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.325526:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.325618:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789575394.325651:0:6704:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9683db2800 10000000:01000000:3.0:1789575394.325657:0:6704:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789575394.325663:0:6704:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e96879b99c0 10000000:01000000:3.0:1789575394.325665:0:6704:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789575394.325669:0:6704:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e96879b99c0 from 1 10000000:01000000:3.0:1789575394.325672:0:6704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789575394.325705:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.325713:0:6704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.325723:0:6704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.325741:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293312:0@lo:101: 00000100:00100000:3.0:1789575394.325789:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.325843:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54300 going to sleep for 11 seconds 00000100:00100000:1.0:1789575394.325929:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293312 00000100:00100000:1.0:1789575394.325937:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293312 00000100:00100000:1.0:1789575394.325987:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789575394.325997:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+10:6704:x1876505699293312:12345-0@lo:101: 00010000:00010000:1.0:1789575394.326008:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575394.326031:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1200/0xc45cc82a22382f44 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f3d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.326057:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1200/0xc45cc82a22382f44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f3d expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.326069:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1200/0xc45cc82a22382f44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f3d expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575394.326081:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1200, rc 0) 00000100:00100000:3.0:1789575394.326241:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293312:0@lo:101: 00010000:00010000:3.0:1789575394.326254:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326264:0:6704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.326283:0:6704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789575394.326297:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326311:0:6704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.326319:0:6704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789575394.326322:0:6704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789575394.326328:0:6704:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789575394.326330:0:6704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789575394.326345:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326352:0:6704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326360:0:6704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.326398:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293440:0@lo:101: 00000100:00100000:3.0:1789575394.326426:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.326449:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.326463:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293440 00000100:00100000:3.0:1789575394.326467:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293440 00000100:00100000:3.0:1789575394.326486:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789575394.326492:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699293440:12345-0@lo:101: 00010000:00010000:3.0:1789575394.326499:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575394.326508:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f4b expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326523:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326546:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326554:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156400, rc 0) 00000100:00100000:3.0:1789575394.326585:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293440:12345-0@lo:101: Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.326689:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789575394.326734:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293440:0@lo:101: 00010000:00010000:3.0:1789575394.326745:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.326753:0:6704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.326856:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293568:0@lo:501: 00000100:00100000:3.0:1789575394.326883:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.326898:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.326912:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293568 00000100:00100000:3.0:1789575394.326915:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293568 00000100:00100000:3.0:1789575394.326932:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789575394.326938:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293568:12345-0@lo:501: 00000100:00100000:3.0:1789575394.327166:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293568:12345-0@lo:501: Request processed in 228us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.327171:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789575394.327192:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293568:0@lo:501: 00000100:00100000:3.0:1789575394.327214:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293696:0@lo:503: 00000100:00100000:3.0:1789575394.327256:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.327270:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.327282:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293696 00000100:00100000:3.0:1789575394.327286:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293696 00000100:00100000:3.0:1789575394.327301:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789575394.327307:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293696:12345-0@lo:503: 00000100:00100000:3.0:1789575394.327485:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293696:12345-0@lo:503: Request processed in 177us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.327492:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789575394.327532:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293696:0@lo:503: 00000040:00080000:3.0:1789575394.327816:0:6704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575394.327892:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293824:0@lo:502: 00000100:00100000:3.0:1789575394.327923:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.327948:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.327962:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293824 00000100:00100000:3.0:1789575394.327966:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293824 00000100:00100000:3.0:1789575394.327983:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789575394.327987:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293824:12345-0@lo:502: 00000100:00100000:3.0:1789575394.328081:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293824:12345-0@lo:502: Request processed in 93us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.328085:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789575394.328111:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293824:0@lo:502: 00000040:00080000:3.0:1789575394.328303:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789575394.328348:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789575394.328413:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789575394.328455:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789575394.328476:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789575394.328505:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789575394.328519:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293952:0@lo:502: 00000100:00100000:3.0:1789575394.328542:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.328556:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.328566:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699293952 00000100:00100000:3.0:1789575394.328569:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699293952 00000100:00100000:3.0:1789575394.328581:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789575394.328585:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293952:12345-0@lo:502: 00000100:00100000:3.0:1789575394.328678:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699293952:12345-0@lo:502: Request processed in 91us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.328685:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789575394.328721:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699293952:0@lo:502: 00000040:00080000:3.0:1789575394.328790:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789575394.328799:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:1.0:1789575394.329179:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699293312:12345-0@lo:101: Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575394.329186:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789575394.329478:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575394.329488:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329496:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575394.329499:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329506:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575394.329512:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575394.329515:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575394.329538:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329541:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575394.329562:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329567:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2076000/0xc45cc82a22382f2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a22382f36 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329584:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575394.329586:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575394.329587:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575394.329623:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699294080:0@lo:103: 00000100:00100000:0.0:1789575394.329661:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575394.329782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294080 00000100:00100000:2.0:1789575394.329788:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294080 00000100:00100000:2.0:1789575394.329845:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789575394.329853:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699294080:12345-0@lo:103: 00010000:00010000:2.0:1789575394.329866:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575394.329881:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1800/0xc45cc82a22382f36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22382f2f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.329895:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575394.330082:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+11:3309:x1876505699294080:12345-0@lo:103: Request processed in 230us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.330087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575394.330299:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699294080:0@lo:103: 00000020:01000000:0.0:1789575394.330573:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789575394.330583:0:6724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789575394.330590:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575394.330592:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789575394.330598:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789575394.330612:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e9690ba99c0) 00000020:00000080:0.0:1789575394.330633:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789575394.330639:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789575394.330704:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9683db2800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789575394.330712:0:6724:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789575394.330718:0:6724:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc45cc82a22382f60 00010000:00010000:2.0:1789575394.334688:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789575394.335019:0:6724:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789575394.337421:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789575394.337739:0:6724:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789575394.344263:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789575394.345294:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789575394.346922:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789575394.346938:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575394.346947:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575394.346950:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789575394.346954:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575394.346960:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575394.346961:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789575394.346973:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789575394.346975:0:6724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789575394.347026:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575394.347030:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575394.347031:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789575394.347035:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789575394.347277:0:6704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789575394.347304:0:6704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789575394.347368:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.347407:0:6704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.347416:0:6704:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9683db2800 from 1 10000000:01000000:3.0:1789575394.347419:0:6704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575394.347457:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.347466:0:6704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.347492:0:6704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.347516:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294208:0@lo:101: 00000100:00100000:3.0:1789575394.347598:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.347644:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.352343:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294208 00000100:00100000:2.0:1789575394.352364:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294208 00000100:00100000:2.0:1789575394.352449:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789575394.352460:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+11:6704:x1876505699294208:12345-0@lo:101: 00010000:00010000:2.0:1789575394.352479:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575394.352498:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f67 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.352527:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.352541:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.352549:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:2.0:1789575394.352644:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294208:12345-0@lo:101: Request processed in 186us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.352651:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789575394.352773:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294208:0@lo:101: 00010000:00010000:3.0:1789575394.352793:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.352803:0:6704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.352945:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294336:0@lo:501: 00000100:00100000:3.0:1789575394.352987:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.353035:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.353089:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294336 00000100:00100000:2.0:1789575394.353094:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294336 00000100:00100000:2.0:1789575394.353124:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789575394.353131:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294336:12345-0@lo:501: 00000100:00100000:2.0:1789575394.353513:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294336:12345-0@lo:501: Request processed in 381us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.353531:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789575394.353605:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294336:0@lo:501: 00000100:00100000:3.0:1789575394.353630:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294464:0@lo:503: 00000100:00100000:3.0:1789575394.353671:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.353699:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.354268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294464 00000100:00100000:2.0:1789575394.354279:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294464 00000100:00100000:2.0:1789575394.354319:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789575394.354329:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294464:12345-0@lo:503: 00000100:00100000:2.0:1789575394.354644:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294464:12345-0@lo:503: Request processed in 316us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.354651:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789575394.354755:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294464:0@lo:503: 00000040:00080000:3.0:1789575394.355169:0:6704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575394.355251:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294592:0@lo:502: 00000100:00100000:3.0:1789575394.355302:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.355345:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.355513:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294592 00000100:00100000:2.0:1789575394.355520:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294592 00000100:00100000:2.0:1789575394.355561:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789575394.355568:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294592:12345-0@lo:502: 00000100:00100000:2.0:1789575394.355745:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294592:12345-0@lo:502: Request processed in 177us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.355752:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789575394.355862:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294592:0@lo:502: 00000040:00080000:1.0:1789575394.356246:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789575394.356308:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789575394.356338:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294720:0@lo:502: 00000100:00100000:1.0:1789575394.356477:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.356510:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96ac0ba240 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.356642:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294720 00000100:00100000:3.0:1789575394.356648:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294720 00000100:00100000:3.0:1789575394.356685:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789575394.356694:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294720:12345-0@lo:502: 00000100:00100000:3.0:1789575394.356864:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294720:12345-0@lo:502: Request processed in 171us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.356871:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789575394.357034:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294720:0@lo:502: 00000040:00080000:1.0:1789575394.357141:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789575394.357224:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789575394.360896:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575394.360915:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575394.360918:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789575394.360925:0:6727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9683db2800 00000020:00000080:1.0:1789575394.360927:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789575394.360949:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575394.360953:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575394.360954:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789575394.360958:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789575394.361131:0:6704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789575394.361173:0:6704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575394.361203:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361216:0:6704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575394.361262:0:6704:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789575394.361265:0:6704:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9683db2800 10000000:01000000:3.0:1789575394.361269:0:6704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9683db2800 10000000:01000000:3.0:1789575394.361273:0:6704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789575394.361280:0:6704:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9683db2800 from 1 10000000:01000000:3.0:1789575394.361282:0:6704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789575394.361320:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361330:0:6704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361343:0:6704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.361396:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294848:0@lo:101: 00000100:00100000:3.0:1789575394.361497:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.361569:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294848 00000100:00100000:3.0:1789575394.361578:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294848 00000100:00100000:3.0:1789575394.361635:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789575394.361646:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699294848:12345-0@lo:101: 00010000:00010000:3.0:1789575394.361661:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575394.361693:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f75 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361723:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361735:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361746:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1c00, rc 0) 00000100:00100000:3.0:1789575394.361785:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699294848:12345-0@lo:101: Request processed in 141us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.361792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789575394.361857:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968300a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.361887:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294848:0@lo:101: 00010000:00010000:3.0:1789575394.361906:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.361916:0:6704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.362019:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294976:0@lo:501: 00000100:00100000:3.0:1789575394.362053:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575394.362067:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968300a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789575394.365538:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699294976 00000100:00100000:2.0:1789575394.365560:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699294976 00000100:00100000:2.0:1789575394.366271:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789575394.366288:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699294976:12345-0@lo:501: 00000100:00100000:2.0:1789575394.373160:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699294976:12345-0@lo:501: Request processed in 858us (5086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575394.373194:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789575394.374016:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699294976:0@lo:501: 00000100:00100000:1.0:1789575394.374091:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295104:0@lo:503: 00000100:00100000:1.0:1789575394.374414:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.374459:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96ac0ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.374562:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295104 00000100:00100000:3.0:1789575394.374570:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295104 00000100:00100000:3.0:1789575394.374633:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789575394.374643:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295104:12345-0@lo:503: 00000100:00100000:3.0:1789575394.374865:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295104:12345-0@lo:503: Request processed in 222us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.374873:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789575394.375022:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295104:0@lo:503: 00000040:00080000:1.0:1789575394.375636:0:6704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789575394.375714:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295232:0@lo:502: 00000100:00100000:1.0:1789575394.375764:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.375802:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96ac0ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1789575394.375957:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295232 00000100:00100000:0.0:1789575394.375964:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295232 00000100:00100000:0.0:1789575394.376012:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789575394.376022:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295232:12345-0@lo:502: 00000100:00100000:0.0:1789575394.376264:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295232:12345-0@lo:502: Request processed in 243us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575394.376272:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789575394.376529:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295232:0@lo:502: 00000040:00080000:1.0:1789575394.376882:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789575394.376935:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789575394.376972:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789575394.377020:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789575394.377264:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789575394.377316:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789575394.377353:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789575394.377503:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789575394.377552:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789575394.377590:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789575394.378317:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789575394.378492:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789575394.378531:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789575394.378566:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789575394.379127:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789575394.379249:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789575394.379279:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789575394.379329:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789575394.379366:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789575394.379950:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789575394.380036:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789575394.380078:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789575394.380114:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789575394.383773:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789575394.383929:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789575394.383990:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789575394.384080:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789575394.384115:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789575394.384201:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295360:0@lo:502: 00000100:00100000:1.0:1789575394.384299:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575394.384354:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96ac0ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1789575394.386291:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295360 00000100:00100000:0.0:1789575394.386316:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295360 00000100:00100000:0.0:1789575394.386448:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789575394.386463:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295360:12345-0@lo:502: 00000100:00100000:0.0:1789575394.386889:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295360:12345-0@lo:502: Request processed in 430us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575394.386908:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789575394.387182:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295360:0@lo:502: 00000040:00080000:1.0:1789575394.387304:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789575394.387321:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789575394.389070:0:6729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789575394.389107:0:6729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e9585103380) 00000020:00000080:0.0:1789575394.389131:0:6729:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789575394.389224:0:6729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9683db2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789575394.389228:0:6729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9683db2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789575394.389231:0:6729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9683db2800 3 00010000:00080000:0.0:1789575394.389265:0:6729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e9584e49800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789575394.393473:0:6729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789575394.398535:0:6729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789575394.398577:0:6729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789575394.398606:0:6729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc45cc82a22382f8a 00000100:00080000:0.0:1789575394.398617:0:6729:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575394.398629:0:6729:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e9584e49800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575394.398665:0:6729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e968660dc00 x1876505699295488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789575394.398696:0:6729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789575394.399934:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699295488:0@lo:38: 00000100:00100000:1.0:1789575394.400011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575394.400298:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699295616:0@lo:400: 00000040:00080000:0.0:1789575394.400837:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789575394.401121:0:6704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789575394.401149:0:6704:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789575394.401171:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575394.401195:0:6704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789575394.401238:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789575394.401240:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.401242:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.401243:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575394.401244:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.401246:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.401247:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.401248:0:6704:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575394.401249:0:6704:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575394.401251:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.401253:0:6704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575394.401257:0:6704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789575394.401259:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789575394.401260:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.401261:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.401262:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575394.401264:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.401265:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.401266:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.401267:0:6704:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575394.401268:0:6704:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575394.401269:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.401270:0:6704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575394.401292:0:6704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789575394.401306:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295744:0@lo:253: 00000100:00100000:2.0:1789575394.401350:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575394.401422:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.401485:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295744 00000100:00100000:3.0:1789575394.401492:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295744 00000100:00100000:3.0:1789575394.401533:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789575394.401543:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6704:x1876505699295744:12345-0@lo:253: 20000000:01000000:3.0:1789575394.401574:0:5857:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789575394.401591:0:5857:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789575394.408846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575394.408905:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295488 00000100:00100000:0.0:1789575394.408913:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295488 00000100:00100000:0.0:1789575394.408938:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295616 00000100:00100000:0.0:1789575394.408940:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295616 00000100:00100000:0.0:1789575394.408963:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575394.408971:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699295616:12345-0@lo:400: 00000100:00100000:0.0:1789575394.409049:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699295616:12345-0@lo:400: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575394.409062:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575394.409079:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789575394.409083:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699295488:12345-0@lo:38: 00010000:00080000:0.0:1789575394.409104:0:5862:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:0.0:1789575394.409136:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc45cc82a22382f91 00000004:00100000:0.0:1789575394.409150:0:5862:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789575394.409178:0:5862:0:(import.c:65:import_set_state_nolock()) ffff8e958524c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789575394.409213:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876505699295488:12345-0@lo:38: Request processed in 129us (9202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575394.409219:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789575394.409251:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e968660d180 x1876505699295616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575394.409265:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699295616:0@lo:400: 00010000:00080000:0.0:1789575394.409295:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e968660dc00 x1876505699295488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575394.409304:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575394.409311:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789575394.409319:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789575394.409323:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789575394.409326:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9584e49800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789575394.409331:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699295488:0@lo:38: 20000000:01000000:3.0:1789575394.429270:0:5857:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789575394.429302:0:5857:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789575394.429433:0:5878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789575394.429441:0:5878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789575394.429470:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.429526:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.429536:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.429590:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.429609:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 13 pid: 5854 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575394.429713:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699295872:0@lo:104: 00000100:00100000:0.0:1789575394.429789:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575394.429853:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575394.429934:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699295872 00000100:00100000:3.0:1789575394.429943:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699295872 00000100:00100000:3.0:1789575394.429998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789575394.430008:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699295872:12345-0@lo:104: 00010000:00010000:3.0:1789575394.430022:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575394.430075:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575394.430082:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699295872:12345-0@lo:104: Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.430089:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789575394.430223:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575394.430231:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.430238:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575394.430242:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.430250:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575394.430257:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575394.430274:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789575394.430892:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.430901:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575394.430927:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.430935:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2077c00/0xc45cc82a22382ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382ef0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.430956:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575394.430958:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575394.430960:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575394.430969:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575394.430982:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699296000:0@lo:103: 00000100:00100000:0.0:1789575394.431023:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575394.431066:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296000 00000100:00100000:0.0:1789575394.431072:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296000 00010000:00010000:0.0:1789575394.431096:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 14 pid: 5854 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575394.431119:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575394.431127:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+14:3306:x1876505699296000:12345-0@lo:103: 00010000:00010000:0.0:1789575394.431140:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575394.431156:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 14 pid: 5854 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431167:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 14 pid: 5854 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431194:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431201:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789575394.431214:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013530075s 00010000:00010000:0.0:1789575394.431219:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431227:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431234:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431240:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431246:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575394.431249:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431257:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431266:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431278:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575394.431310:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+14:3306:x1876505699296000:12345-0@lo:103: Request processed in 184us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575394.431323:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575394.431418:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699296000:0@lo:103: 00010000:00010000:0.0:1789575394.431446:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2156600/0xc45cc82a22382ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382ee9 expref: 13 pid: 5854 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575394.431456:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699295872:0@lo:104: 00010000:00010000:0.0:1789575394.431466:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431475:0:5878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431481:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575394.431487:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031e00/0xc45cc82a22382f98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575394.440839:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:6704:x1876505699295744:12345-0@lo:253: Request processed in 39276us (39467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575394.440858:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789575394.440963:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:6704:1876505699295744:0@lo:253: 10000000:01000000:2.0:1789575394.440982:0:6704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789575394.440986:0:6704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575394.440988:0:6704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789575394.441012:0:6704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575394.441013:0:6704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575394.441014:0:6704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575394.441016:0:6704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575394.441017:0:6704:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575394.441018:0:6704:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575394.441020:0:6704:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575394.441022:0:6704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575394.441024:0:6704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789575394.441044:0:6704:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789575394.449318:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575394.449752:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575394.450008:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575394.450278:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575394.450764:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575394.451021:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789575394.452795:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789575394.730585:0:6704:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789575394.730598:0:6704:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789575394.730733:0:6704:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789575394.730834:0:6704:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789575394.730887:0:6704:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789575394.730936:0:6704:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789575395.240696:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789575396.162460:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789575396.162473:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9689726000 from 21 10000000:01000000:1.0:1789575396.162481:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789575396.162560:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.162578:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.162597:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575396.162636:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296128:0@lo:101: 00000100:00100000:1.0:1789575396.162752:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575396.162838:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296128 00000100:00100000:1.0:1789575396.162849:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296128 00000100:00100000:1.0:1789575396.164573:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789575396.164596:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699296128:12345-0@lo:101: 00010000:00010000:1.0:1789575396.164634:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575396.164659:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382f9f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.164710:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.164728:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.164740:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1000, rc 0) 00000100:00100000:1.0:1789575396.164861:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296128:12345-0@lo:101: Request processed in 271us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575396.164879:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789575396.166704:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96905970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575396.166790:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296128:0@lo:101: 00010000:00010000:1.0:1789575396.166847:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575396.167070:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.168822:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296256:0@lo:501: 00000100:00100000:0.0:1789575396.168968:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.169088:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575396.174514:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296256 00000100:00100000:2.0:1789575396.174535:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296256 00000100:00100000:2.0:1789575396.174639:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789575396.174656:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296256:12345-0@lo:501: 00000100:00100000:2.0:1789575396.175465:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296256:12345-0@lo:501: Request processed in 810us (6493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575396.175478:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789575396.175569:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296256:0@lo:501: 00000100:00100000:2.0:1789575396.175641:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296384:0@lo:503: 00000100:00100000:2.0:1789575396.175698:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575396.175733:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96860c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575396.175902:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296384 00000100:00100000:3.0:1789575396.175909:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296384 00000100:00100000:3.0:1789575396.175953:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789575396.175962:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296384:12345-0@lo:503: 00000100:00100000:3.0:1789575396.179687:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296384:12345-0@lo:503: Request processed in 3706us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575396.179709:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789575396.179853:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296384:0@lo:503: 00000100:00100000:0.0:1789575396.188663:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6796:1876505699296512:0@lo:502: 00000100:00100000:0.0:1789575396.194436:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.194558:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575396.194661:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296512 00000100:00100000:1.0:1789575396.194675:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296512 00000100:00100000:1.0:1789575396.194751:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789575396.194763:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6796:x1876505699296512:12345-0@lo:502: 00000100:00100000:1.0:1789575396.195361:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:6796:x1876505699296512:12345-0@lo:502: Request processed in 595us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575396.195419:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789575396.200006:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6796:1876505699296512:0@lo:502: 00000100:00100000:0.0:1789575396.200161:0:6796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6796:1876505699296640:0@lo:502: 00000100:00100000:0.0:1789575396.200284:0:6796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.200349:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296640 00000100:00100000:0.0:1789575396.200359:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296640 00000100:00100000:0.0:1789575396.200452:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789575396.200465:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6796:x1876505699296640:12345-0@lo:502: 00000100:00100000:0.0:1789575396.200802:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:6796:x1876505699296640:12345-0@lo:502: Request processed in 337us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.200826:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789575396.200890:0:6796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.200908:0:6796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6796:1876505699296640:0@lo:502: 00000040:00080000:0.0:1789575396.200939:0:6796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789575396.201055:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789575396.201086:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789575396.201103:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201119:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575396.201132:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789575396.201136:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e9689726000 from 4 10000000:01000000:0.0:1789575396.201140:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789575396.201183:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201193:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201204:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.201231:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296768:0@lo:101: 00000100:00100000:0.0:1789575396.201266:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.201284:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.201302:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296768 00000100:00100000:0.0:1789575396.201308:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296768 00000100:00100000:0.0:1789575396.201339:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789575396.201347:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699296768:12345-0@lo:101: 00010000:00010000:0.0:1789575396.201360:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575396.201412:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382fad expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201446:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382fad expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201459:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fad expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201471:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030a00, rc 0) 00000100:00100000:0.0:1789575396.201503:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699296768:12345-0@lo:101: Request processed in 157us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.201510:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789575396.201544:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296768:0@lo:101: 00010000:00010000:0.0:1789575396.201559:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201571:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.201641:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296896:0@lo:256: 00000100:00100000:0.0:1789575396.201673:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.201686:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.201700:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699296896 00000100:00100000:0.0:1789575396.201704:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699296896 00000100:00100000:0.0:1789575396.201727:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789575396.201734:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699296896:12345-0@lo:256: 20000000:01000000:0.0:1789575396.201750:0:5857:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789575396.201773:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789575396.201776:0:5857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789575396.201889:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699296896:12345-0@lo:256: Request processed in 154us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.201897:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789575396.201928:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699296896:0@lo:256: 10000000:01000000:0.0:1789575396.201977:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789575396.201985:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.201993:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575396.202001:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789575396.202003:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789575396.202006:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789575396.202025:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202043:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202052:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.202063:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297024:0@lo:101: 00000100:00100000:0.0:1789575396.202089:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.202102:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.202118:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297024 00000100:00100000:0.0:1789575396.202122:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297024 00000100:00100000:0.0:1789575396.202143:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789575396.202149:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699297024:12345-0@lo:101: 00010000:00010000:0.0:1789575396.202157:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575396.202167:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382fbb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202185:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202195:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202201:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030800, rc 0) 00000100:00100000:0.0:1789575396.202228:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699297024:12345-0@lo:101: Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.202233:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789575396.202261:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297024:0@lo:101: 00010000:00010000:0.0:1789575396.202279:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.202288:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.202342:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297152:0@lo:501: 00000100:00100000:0.0:1789575396.202400:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.202413:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.202424:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297152 00000100:00100000:0.0:1789575396.202428:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297152 00000100:00100000:0.0:1789575396.202444:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789575396.202450:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699297152:12345-0@lo:501: 00000100:00100000:0.0:1789575396.202799:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699297152:12345-0@lo:501: Request processed in 347us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.208188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789575396.208393:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297152:0@lo:501: 00000100:00100000:0.0:1789575396.208491:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297280:0@lo:503: 00000100:00100000:0.0:1789575396.208638:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.208687:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.208746:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297280 00000100:00100000:0.0:1789575396.208756:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297280 00000100:00100000:0.0:1789575396.208830:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789575396.208844:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699297280:12345-0@lo:503: 00000100:00100000:0.0:1789575396.209886:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699297280:12345-0@lo:503: Request processed in 1034us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.209902:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789575396.210021:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699297280:0@lo:503: 00000100:00100000:0.0:1789575396.210571:0:6799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6799:1876505699297408:0@lo:502: 00000100:00100000:0.0:1789575396.210635:0:6799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.210668:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297408 00000100:00100000:0.0:1789575396.210674:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297408 00000100:00100000:0.0:1789575396.210716:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789575396.210725:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:6799:x1876505699297408:12345-0@lo:502: 00000100:00100000:0.0:1789575396.211085:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:6799:x1876505699297408:12345-0@lo:502: Request processed in 360us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.211094:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789575396.211145:0:6799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.211168:0:6799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6799:1876505699297408:0@lo:502: 00000020:01000000:0.0:1789575396.211200:0:6799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789575396.211211:0:6799:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789575396.211221:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575396.211223:0:6799:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789575396.211229:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789575396.211233:0:6799:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789575396.211266:0:6799:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789575396.211269:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789575396.211288:0:6799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e9585104d40) 00000020:00000080:0.0:1789575396.211318:0:6799:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789575396.211325:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789575396.211464:0:6799:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789575396.211471:0:6799:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789575396.211479:0:6799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22382fd0 00010000:00080000:0.0:1789575396.211520:0:6799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e9584e4b800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789575396.225063:0:6799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1789575396.272392:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789575396.297918:0:6799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789575396.297963:0:6799:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789575396.298997:0:6799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789575396.299324:0:6799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789575396.299408:0:6799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789575396.299469:0:6799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789575396.302668:0:6803:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575396.302679:0:6803:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789575396.303229:0:6799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789575396.303245:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789575396.303303:0:6799:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789575396.303344:0:6799:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a22382fd7 00000100:00080000:2.0:1789575396.303368:0:6799:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789575396.303516:0:6799:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9584e4b800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575396.303579:0:6799:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9686981180 x1876505699297536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575396.303652:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699297536:0@lo:8: 00000100:00100000:0.0:1789575396.303758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789575396.303867:0:6799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789575396.303963:0:6799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575396.303968:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575396.303970:0:6799:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789575396.303974:0:6799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575396.303979:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575396.303980:0:6799:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789575396.303983:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789575396.303986:0:6799:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789575396.304021:0:6799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6799:1876505699297664:0@lo:502: 00000100:00100000:2.0:1789575396.304080:0:6799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575396.304105:0:6799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96860c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789575396.304255:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699297792:0@lo:400: 00000100:00100000:1.0:1789575396.304296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575396.304306:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297536 00000100:00100000:3.0:1789575396.304317:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297536 00000100:00100000:1.0:1789575396.304332:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575396.304338:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699297920:0@lo:400: 00000100:00100000:3.0:1789575396.304360:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575396.304360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575396.304398:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699297536:12345-0@lo:8: 00010000:00080000:3.0:1789575396.304432:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000100:00100000:1.0:1789575396.304439:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297792 00000100:00100000:1.0:1789575396.304444:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297792 00000020:00000080:3.0:1789575396.304468:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a22382fde 00000100:00100000:1.0:1789575396.304481:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297920 00000100:00100000:1.0:1789575396.304484:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297920 00000100:00100000:1.0:1789575396.304510:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789575396.304515:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699297792:12345-0@lo:400: 00002000:00100000:3.0:1789575396.304517:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e9584e47800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789575396.304522:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789575396.304528:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789575396.304575:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699297792:12345-0@lo:400: Request processed in 58us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575396.304584:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789575396.304603:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575396.304609:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699297920:12345-0@lo:400: 00000100:00100000:1.0:1789575396.304634:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699297920:12345-0@lo:400: Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575396.304639:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789575396.304673:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789575396.304707:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686982680 x1876505699297920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:3.0:1789575396.304718:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789575396.304723:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699297920:0@lo:400: 00010000:00080000:1.0:1789575396.304733:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686983480 x1876505699297792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575396.304748:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699297792:0@lo:400: 00002000:00080000:3.0:1789575396.304922:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789575396.304960:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e9584e42800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575396.305780:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876505699297536:12345-0@lo:8: Request processed in 1376us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575396.305791:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789575396.305892:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686981180 x1876505699297536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789575406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575396.305904:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575396.305915:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789575396.305927:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789575396.305934:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789575396.305937:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9584e4b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789575396.305957:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789575396.305963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699297536:0@lo:8: 00000100:00100000:0.0:1789575396.306000:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699297664 00000100:00100000:0.0:1789575396.306008:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699297664 00000004:00080000:3.0:1789575396.306110:0:6803:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789575396.306202:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789575396.306214:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+15:6799:x1876505699297664:12345-0@lo:502: 00000100:00100000:0.0:1789575396.306648:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+15:6799:x1876505699297664:12345-0@lo:502: Request processed in 435us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.306657:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1789575396.306909:0:6803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 208393536663ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789575396.310331:0:6799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:6799:1876505699297664:0@lo:502: 00000020:01000000:2.0:1789575396.310420:0:6799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575396.310429:0:6799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575396.310432:0:6799:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789575396.310441:0:6799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789575396.312400:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789575396.312454:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789575396.312473:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.312490:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575396.312502:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789575396.312505:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e96879b99c0 from 1 10000000:01000000:3.0:1789575396.312508:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789575396.312563:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.312573:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.312594:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575396.312625:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699298048:0@lo:101: 00000100:00100000:3.0:1789575396.312726:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575396.312788:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96829dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575396.313033:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298048 00000100:00100000:3.0:1789575396.313043:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298048 00000100:00100000:3.0:1789575396.313108:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789575396.313121:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699298048:12345-0@lo:101: 00010000:00010000:3.0:1789575396.315928:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575396.315970:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22382fe5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.316053:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.316070:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575396.316084:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0a00, rc 0) 00000100:00100000:3.0:1789575396.316710:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699298048:12345-0@lo:101: Request processed in 3587us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575396.316723:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789575396.316902:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699298048:0@lo:101: 00010000:00010000:0.0:1789575396.316931:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.316945:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575396.317043:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699298176:0@lo:501: 00000100:00100000:0.0:1789575396.317097:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.317606:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534480 going to sleep for 11 seconds 00000100:00100000:0.0:1789575396.317629:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298176 00000100:00100000:0.0:1789575396.317640:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298176 00000100:00100000:0.0:1789575396.317688:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789575396.317697:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699298176:12345-0@lo:501: 00000100:00100000:0.0:1789575396.318009:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699298176:12345-0@lo:501: Request processed in 311us (910us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575396.318017:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789575396.318066:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699298176:0@lo:501: 10000000:01000000:0.0:1789575396.318108:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789575396.318120:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575396.318144:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789575396.393783:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789575396.471621:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699298304:0@lo:13: 00000100:00100000:2.0:1789575396.477312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789575396.478317:0:6804:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789575396.478432:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298432:0@lo:7: 00000100:00100000:0.0:1789575396.478523:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.478572:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534240 going to sleep for 11 seconds 00000100:00100000:3.0:1789575396.479065:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298304 00000100:00100000:3.0:1789575396.479079:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298304 00000100:00100000:3.0:1789575396.481973:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575396.481996:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699298304:12345-0@lo:13: 00002000:00000024:3.0:1789575396.482072:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:0.0:1789575396.483273:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575396.486608:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699298304:12345-0@lo:13: Request processed in 4595us (9292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575396.486646:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575396.487338:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298432 00000100:00100000:3.0:1789575396.487353:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298432 00000100:00100000:3.0:1789575396.488322:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575396.488341:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6804:x1876505699298432:12345-0@lo:7: 00010000:00080000:2.0:1789575396.491792:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660d880 x1876505699298304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575396.491842:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699298304:0@lo:13: 00002000:00080000:3.0:1789575396.506097:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789575396.508606:0:6709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789575396.508846:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6804:x1876505699298432:12345-0@lo:7: Request processed in 20504us (30315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575396.508860:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789575396.512520:0:6804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660fb80 x1876505699298432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789575412 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575396.512551:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298432:0@lo:7: 00000004:00080000:0.0:1789575396.512576:0:6804:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789575396.512659:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298560:0@lo:5: 00000100:00100000:0.0:1789575396.512753:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575396.512947:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534240 going to sleep for 11 seconds 00000100:00100000:3.0:1789575396.515360:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298560 00000100:00100000:3.0:1789575396.515452:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298560 00000100:00100000:3.0:1789575396.515848:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789575396.515865:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6804:x1876505699298560:12345-0@lo:5: 00002000:00080000:3.0:1789575396.515924:0:6706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789575396.515931:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789575396.516574:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6804:x1876505699298560:12345-0@lo:5: Request processed in 712us (3819us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789575396.516584:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789575396.517156:0:6804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660fb80 x1876505699298560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789575412 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575396.517202:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298560:0@lo:5: 00000004:00080000:2.0:1789575396.517235:0:6804:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789575396.517302:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298688:0@lo:700: 00000100:00100000:2.0:1789575396.517363:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575396.517422:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575396.517462:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298688 00000100:00100000:2.0:1789575396.517470:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298688 00000100:00100000:2.0:1789575396.517519:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789575396.517529:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6804:x1876505699298688:12345-0@lo:700: 00000100:00100000:2.0:1789575396.517574:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6715:1876505699298816:0@lo:700: 00000100:00100000:2.0:1789575396.517617:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575396.517634:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575396.521496:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298816 00000100:00100000:1.0:1789575396.521519:0:5869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298816 00000100:00100000:1.0:1789575396.521600:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575396.521614:0:5869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6715:x1876505699298816:12345-0@lo:700: 40000000:02000000:0.0:1789575396.574982:0:5869:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789575396.588067:0:5869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6715:x1876505699298816:12345-0@lo:700: Request processed in 66354us (70346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.588103:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789575396.588311:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686980380 x1876505699298816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789575412 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575396.588332:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6715:1876505699298816:0@lo:700: 40000000:02000000:2.0:1789575396.588353:0:6715:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789575396.731033:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789575396.731059:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789575396.731626:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6804:x1876505699298688:12345-0@lo:700: Request processed in 214088us (214253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575396.731651:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789575396.731827:0:6804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686983b80 x1876505699298688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789575412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575396.731842:0:6804:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789575396.731865:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298688:0@lo:700: 00000004:02000040:2.0:1789575396.789654:0:6804:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789575396.797001:0:6804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298944:0@lo:5: 00000100:00100000:3.0:1789575396.798510:0:6804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575396.798657:0:6804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001240 going to sleep for 11 seconds 00000100:00100000:1.0:1789575396.799219:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699298944 00000100:00100000:1.0:1789575396.799233:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699298944 00000100:00100000:1.0:1789575396.799350:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575396.799363:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6804:x1876505699298944:12345-0@lo:5: 00002000:00080000:0.0:1789575396.806540:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789575396.806575:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789575396.811753:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6804:x1876505699298944:12345-0@lo:5: Request processed in 12372us (14611us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789575396.811779:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789575396.811923:0:6804:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb213100 x1876505699298944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789575412 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575396.811951:0:6804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6804:1876505699298944:0@lo:5: 00000004:00080000:3.0:1789575396.812001:0:6804:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789575397.293200:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575398.316889:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575399.336747:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575400.364262:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575401.384750:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699299200:0@lo:400: 00000100:00100000:2.0:1789575401.384752:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699299456:0@lo:400: 00000100:00100000:0.0:1789575401.385007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575401.385161:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575401.385168:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699299328:0@lo:400: 00000100:00100000:0.0:1789575401.385195:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575401.385309:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299200 00000100:00100000:0.0:1789575401.385319:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299200 00000100:00100000:0.0:1789575401.385577:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299328 00000100:00100000:0.0:1789575401.385581:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299328 00000100:00100000:0.0:1789575401.385613:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575401.385746:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699299200:12345-0@lo:400: 00000100:00100000:0.0:1789575401.385835:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699299200:12345-0@lo:400: Request processed in 91us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575401.385855:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575401.385879:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575401.385887:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699299328:12345-0@lo:400: 00000100:00100000:0.0:1789575401.385919:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699299328:12345-0@lo:400: Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575401.386103:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789575401.386133:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789575401.386167:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660ce00 x1876505699299328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575401.386183:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699299328:0@lo:400: 00010000:00080000:0.0:1789575401.386198:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660ca80 x1876505699299200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575401.386207:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699299200:0@lo:400: 00000100:00100000:1.0:1789575401.386531:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699299072:0@lo:400: 00000100:00100000:1.0:1789575401.386600:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575401.386693:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299072 00000100:00100000:1.0:1789575401.386700:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299072 00000100:00100000:1.0:1789575401.386737:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789575401.386745:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:3307:x1876505699299072:12345-0@lo:400: 00000100:00100000:1.0:1789575401.386798:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:3307:x1876505699299072:12345-0@lo:400: Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575401.386805:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:1.0:1789575401.386838:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575401.386869:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699299072:0@lo:400: 00000100:00100000:2.0:1789575401.386879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575401.386912:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299456 00000100:00100000:1.0:1789575401.386916:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299456 00000100:00080000:2.0:1789575401.386940:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789575401.386953:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575401.386959:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699299456:12345-0@lo:400: 00000100:00100000:1.0:1789575401.387007:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699299456:12345-0@lo:400: Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575401.387014:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789575401.387601:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660df80 x1876505699299456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575401.387628:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699299456:0@lo:400: 00000100:00100000:1.0:1789575401.896748:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699299584:0@lo:13: 00000100:00100000:1.0:1789575401.896858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575401.896980:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299584 00000100:00100000:1.0:1789575401.896990:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299584 00000100:00100000:1.0:1789575401.897043:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575401.897053:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699299584:12345-0@lo:13: 00002000:00000024:1.0:1789575401.897199:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575401.897252:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699299584:12345-0@lo:13: Request processed in 199us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575401.897259:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789575401.897315:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255880 x1876505699299584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575401.897337:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699299584:0@lo:13: 00000001:00080000:2.0:1789575402.031252:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789575402.408512:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789575403.166536:0:7079:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789575403.443195:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575404.456549:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575405.481822:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575406.504692:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575406.505333:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699299968:0@lo:400: 00000100:00100000:3.0:1789575406.505437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575406.505556:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699299840:0@lo:400: 00000100:00100000:2.0:1789575406.505596:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575406.505625:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789575406.505631:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699299712:0@lo:400: 00000100:00100000:2.0:1789575406.505659:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575406.505703:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299968 00000100:00100000:2.0:1789575406.505722:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299968 00000100:00100000:2.0:1789575406.505785:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299840 00000100:00100000:2.0:1789575406.505790:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299840 00000100:00100000:2.0:1789575406.505812:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575406.505824:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699299968:12345-0@lo:400: 00000100:00080000:0.0:1789575406.505978:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575406.505993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699299712 00000100:00100000:0.0:1789575406.505997:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699299712 00000100:00100000:0.0:1789575406.506040:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789575406.506048:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:3309:x1876505699299712:12345-0@lo:400: 00000100:00100000:0.0:1789575406.506088:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:3309:x1876505699299712:12345-0@lo:400: Request processed in 41us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575406.506095:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789575406.506141:0:5862:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789575406.506150:0:5862:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789575406.506172:0:5864:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789575406.506179:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575406.506211:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699299840:12345-0@lo:400: 00000100:00100000:0.0:1789575406.506242:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699299840:12345-0@lo:400: Request processed in 44us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575406.506248:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575406.506529:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699299712:0@lo:400: 00010000:00080000:0.0:1789575406.506547:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255c00 x1876505699299840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575406.506560:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699299840:0@lo:400: 00000100:00100000:0.0:1789575406.507774:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699300096:0@lo:400: 00000100:00100000:0.0:1789575406.507835:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575406.507913:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300096 00000100:00100000:0.0:1789575406.507921:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300096 00000100:00100000:0.0:1789575406.507988:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575406.507997:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699300096:12345-0@lo:400: 00000100:00100000:0.0:1789575406.508055:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699300096:12345-0@lo:400: Request processed in 59us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575406.508062:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789575406.508087:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789575406.508116:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb257100 x1876505699300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575406.508128:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789575406.508142:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699300096:0@lo:400: 00000100:00100000:2.0:1789575406.509960:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699299968:12345-0@lo:400: Request processed in 4128us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575406.509978:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789575406.510285:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255180 x1876505699299968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575406.510303:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699299968:0@lo:400: 00000100:00100000:1.0:1789575407.024908:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699300224:0@lo:13: 00000100:00100000:1.0:1789575407.024993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575407.025088:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300224 00000100:00100000:1.0:1789575407.025097:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300224 00000100:00100000:1.0:1789575407.025159:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575407.025170:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699300224:12345-0@lo:13: 00002000:00000024:1.0:1789575407.025215:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575407.025273:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699300224:12345-0@lo:13: Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575407.025280:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789575407.026015:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb257480 x1876505699300224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575407.026051:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699300224:0@lo:13: 00010000:00010000:2.0:1789575407.530556:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575408.554521:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575409.577763:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575410.601483:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575411.627352:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699300352:0@lo:400: 00000100:00100000:1.0:1789575411.627455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575411.627531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575411.627538:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699300736:0@lo:400: 00000100:00100000:1.0:1789575411.627566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575411.627598:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699300480:0@lo:400: 00000100:00100000:1.0:1789575411.627624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575411.627642:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575411.627648:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699300608:0@lo:400: 00000100:00100000:1.0:1789575411.627680:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575411.627711:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300352 00000100:00100000:1.0:1789575411.627720:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300352 00000100:00100000:1.0:1789575411.627770:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789575411.627780:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:3309:x1876505699300352:12345-0@lo:400: 00000100:00100000:1.0:1789575411.627839:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:3309:x1876505699300352:12345-0@lo:400: Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575411.627847:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789575411.627914:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300736 00000100:00100000:1.0:1789575411.627919:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300736 00000100:00100000:1.0:1789575411.627957:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575411.627964:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699300736:12345-0@lo:400: 00000100:00100000:1.0:1789575411.628016:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699300736:12345-0@lo:400: Request processed in 52us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575411.628022:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789575411.628065:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255180 x1876505699300736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575411.628080:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699300736:0@lo:400: 00000100:00100000:1.0:1789575411.628090:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699300352:0@lo:400: 00010000:00010000:0.0:1789575411.628430:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575411.628455:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300480 00000100:00100000:0.0:1789575411.628460:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300480 00000100:00100000:0.0:1789575411.628501:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300608 00000100:00100000:0.0:1789575411.628505:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300608 00000100:00100000:0.0:1789575411.628544:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789575411.628552:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699300480:12345-0@lo:400: 00000100:00100000:0.0:1789575411.628599:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699300480:12345-0@lo:400: Request processed in 47us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575411.628605:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789575411.628621:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789575411.628628:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699300608:12345-0@lo:400: 00000100:00100000:0.0:1789575411.628656:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699300608:12345-0@lo:400: Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575411.628662:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789575411.628698:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789575411.628705:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789575411.628739:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb257480 x1876505699300608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575411.628752:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699300608:0@lo:400: 00010000:00080000:0.0:1789575411.628765:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255500 x1876505699300480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575411.628774:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699300480:0@lo:400: 00000100:00100000:1.0:1789575412.137535:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575412.137584:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699300864:0@lo:13: 00000100:00100000:1.0:1789575412.137706:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575412.137971:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300864 00000100:00100000:0.0:1789575412.137985:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300864 00000100:00100000:0.0:1789575412.138152:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575412.138164:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699300864:12345-0@lo:13: 00002000:00000024:0.0:1789575412.138211:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575412.138271:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699300864:12345-0@lo:13: Request processed in 110us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575412.138279:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789575412.139408:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb254000 x1876505699300864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575412.139443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699300864:0@lo:13: 00010000:00010000:1.0:1789575412.650638:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575413.672584:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575414.696603:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575415.722179:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575416.744847:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575416.745260:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699301248:0@lo:400: 00000100:00100000:0.0:1789575416.745355:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575416.746314:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699301120:0@lo:400: 00000100:00100000:3.0:1789575416.746392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575416.747736:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699300992:0@lo:400: 00000100:00100000:1.0:1789575416.747821:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575416.747924:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301248 00000100:00100000:1.0:1789575416.747936:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301248 00000100:00100000:0.0:1789575416.748110:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575416.748122:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699301376:0@lo:400: 00000100:00100000:0.0:1789575416.748164:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575416.748209:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301120 00000100:00100000:0.0:1789575416.748214:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301120 00000100:00100000:0.0:1789575416.748277:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789575416.748287:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699301120:12345-0@lo:400: 00000100:00100000:0.0:1789575416.748345:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699301120:12345-0@lo:400: Request processed in 59us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575416.748351:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789575416.748391:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301376 00000100:00100000:0.0:1789575416.748394:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301376 00000100:00100000:1.0:1789575416.748540:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789575416.748546:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699301248:12345-0@lo:400: 00000100:00100000:1.0:1789575416.748585:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699301248:12345-0@lo:400: Request processed in 39us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575416.748591:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789575416.748643:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660dc00 x1876505699301248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575416.748672:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699301248:0@lo:400: 00010000:00080000:1.0:1789575416.748725:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660d880 x1876505699301120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575416.748733:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699301120:0@lo:400: 00000100:00080000:1.0:1789575416.748769:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575416.748774:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575416.750227:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699300992 00000100:00100000:3.0:1789575416.750240:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699300992 00000100:00100000:3.0:1789575416.750299:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789575416.750309:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:3306:x1876505699300992:12345-0@lo:400: 00000100:00100000:3.0:1789575416.750414:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:3306:x1876505699300992:12345-0@lo:400: Request processed in 107us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575416.750420:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789575416.750730:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575416.750743:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699301376:12345-0@lo:400: 00000100:00100000:1.0:1789575416.750805:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699301376:12345-0@lo:400: Request processed in 67us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575416.750811:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575416.750869:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699300992:0@lo:400: 00010000:00080000:0.0:1789575416.752214:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660c700 x1876505699301376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575416.752230:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699301376:0@lo:400: 00000020:01000004:2.0:1789575417.146551:0:7649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789575417.146556:0:7649:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789575417.146741:0:7649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e95850a0800 00000020:01000004:2.0:1789575417.146764:0:7649:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789575417.146781:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789575417.146816:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e96bbee0000) 00000020:00000080:2.0:1789575417.146834:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789575417.169723:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789575417.170129:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789575417.221156:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789575417.249316:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789575417.249357:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789575417.249447:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789575417.249477:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789575417.250171:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789575417.250184:0:7649:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789575417.250195:0:7649:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc45cc82a22382ffa 00000020:01000004:2.0:1789575417.250270:0:7649:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789575417.250297:0:7649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789575417.250302:0:7649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789575417.250307:0:7649:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789575417.250333:0:7649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789575417.250338:0:7649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:0.0:1789575417.256762:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575417.256795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699301504:0@lo:13: 00000100:00100000:0.0:1789575417.256911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.257007:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301504 00000100:00100000:0.0:1789575417.257015:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301504 00000100:00100000:0.0:1789575417.257071:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789575417.257082:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699301504:12345-0@lo:13: 00002000:00000024:0.0:1789575417.257117:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575417.257165:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699301504:12345-0@lo:13: Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575417.257172:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789575417.257230:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb254a80 x1876505699301504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575417.257248:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699301504:0@lo:13: 00000040:01000000:1.0:1789575417.326622:0:7649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789575417.326692:0:7649:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789575417.326698:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789575417.326700:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789575417.326702:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789575417.326703:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789575417.326705:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789575417.326706:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789575417.326707:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789575417.326708:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789575417.326710:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789575417.326711:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789575417.326712:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789575417.326717:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789575417.326719:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789575417.326720:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789575417.326721:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789575417.326729:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789575417.326730:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789575417.326731:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789575417.326732:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789575417.326732:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789575417.326733:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789575417.326734:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789575417.326735:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789575417.326776:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789575417.326799:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699301632:0@lo:253: 00000100:00100000:1.0:1789575417.326896:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.326956:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.327699:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301632 00000100:00100000:0.0:1789575417.327710:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301632 00000100:00100000:0.0:1789575417.327778:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789575417.327791:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:7649:x1876505699301632:12345-0@lo:253: 20000000:01000000:0.0:1789575417.327833:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789575417.327839:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789575417.327845:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789575417.327850:0:5856:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789575417.329141:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575417.329412:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789575417.329428:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789575417.329468:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789575417.329476:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789575417.329506:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789575417.329566:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789575417.330040:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789575417.330061:0:5856:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:0.0:1789575417.330063:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:0.0:1789575417.330118:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789575417.330126:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789575417.330173:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789575417.330181:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:0.0:1789575417.330215:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789575417.330225:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789575417.330255:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789575417.330327:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789575417.345858:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789575417.346193:0:5856:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:3.0:1789575417.346197:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789575417.346247:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789575417.346255:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789575417.346283:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789575417.346306:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:3.0:1789575417.346340:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789575417.346349:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789575417.346535:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789575417.346667:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789575417.346819:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789575417.346823:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789575417.346831:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789575417.346832:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789575417.346835:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789575417.346853:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789575417.346856:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789575417.347113:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789575417.347116:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789575417.354464:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789575417.354586:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789575417.354654:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789575417.356642:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789575417.356843:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789575417.360269:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789575417.360317:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789575417.360322:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789575417.361598:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789575417.361807:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789575417.362052:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789575417.362857:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789575417.364168:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789575417.364222:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789575417.364241:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789575417.364243:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789575417.365262:0:7652:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789575417.365335:0:7652:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789575417.365607:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789575417.366248:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789575417.366287:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789575417.366352:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789575417.366365:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789575417.366367:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789575417.367037:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789575417.367468:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789575417.367509:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789575417.367573:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1789575417.367593:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789575417.367626:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367654:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367662:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367667:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367673:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367680:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367686:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367846:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.367862:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 16 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.367877:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699301760:0@lo:104: 00000100:00100000:0.0:1789575417.367956:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789575417.368007:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.368014:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.368029:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699301888:0@lo:104: 00010000:00010000:0.0:1789575417.368056:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.368063:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 16 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.368070:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302016:0@lo:104: 00010000:00010000:0.0:1789575417.368090:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.368097:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.368103:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302144:0@lo:104: 00010000:00010000:0.0:1789575417.368122:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 16 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.368129:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 16 pid: 5857 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.368135:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302272:0@lo:104: 00000100:00100000:0.0:1789575417.368151:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.368562:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789575417.368584:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.368620:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.368631:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.368639:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.368658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301760 00000100:00100000:2.0:1789575417.368666:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301760 00000100:00100000:3.0:1789575417.368770:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699301888 00000100:00100000:3.0:1789575417.368774:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699301888 00000100:00100000:3.0:1789575417.368803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302016 00000100:00100000:3.0:1789575417.368805:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302016 00000100:00100000:3.0:1789575417.368815:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302144 00000100:00100000:3.0:1789575417.368818:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302144 00000100:00100000:3.0:1789575417.368826:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302272 00000100:00100000:3.0:1789575417.368828:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302272 00000100:00100000:3.0:1789575417.368841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789575417.368849:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+7:5856:x1876505699301888:12345-0@lo:104: 00010000:00010000:3.0:1789575417.368863:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.368950:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575417.368956:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+7:5856:x1876505699301888:12345-0@lo:104: Request processed in 108us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.368963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789575417.368980:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789575417.368987:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+6:5856:x1876505699302016:12345-0@lo:104: 00010000:00010000:3.0:1789575417.368994:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369028:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789575417.369034:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+6:5856:x1876505699302016:12345-0@lo:104: Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.369039:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789575417.369052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789575417.369058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+5:5856:x1876505699302144:12345-0@lo:104: 00010000:00010000:3.0:1789575417.369065:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369094:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789575417.369098:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+5:5856:x1876505699302144:12345-0@lo:104: Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.369104:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789575417.369115:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789575417.369120:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+4:5856:x1876505699302272:12345-0@lo:104: 00010000:00010000:3.0:1789575417.369127:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369160:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789575417.369166:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+4:5856:x1876505699302272:12345-0@lo:104: Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.369171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789575417.369188:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789575417.369193:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369200:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575417.369204:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369213:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575417.369220:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575417.369225:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575417.369258:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369265:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575417.369287:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369295:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a22382fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fc2 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369322:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789575417.369325:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369330:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575417.369333:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369339:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575417.369345:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575417.369350:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575417.369365:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369396:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575417.369413:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369420:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a22382f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fa6 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369430:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575417.369433:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369448:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575417.369451:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369457:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575417.369463:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575417.369468:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575417.369483:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369488:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575417.369493:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369499:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22382f75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f7c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369510:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575417.369514:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369519:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575417.369522:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369537:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575417.369543:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575417.369547:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575417.369562:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369567:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575417.369571:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369577:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2157c00/0xc45cc82a22382f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f52 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.369627:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575417.369628:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575417.369630:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575417.369638:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575417.369662:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302400:0@lo:103: 00000100:00100000:2.0:1789575417.369864:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575417.369874:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690aff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5856:x1876505699301760:12345-0@lo:104: 00010000:00010000:2.0:1789575417.369884:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.369923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.370000:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699302528:0@lo:103: 00010000:00010000:2.0:1789575417.370656:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575417.370666:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690aff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5856:x1876505699301760:12345-0@lo:104: Request processed in 793us (2709us total) trans 0 rc 0/0 00010000:00010000:1.0:1789575417.370767:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575417.370774:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.370781:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575417.370784:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.370793:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575417.370800:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575417.370805:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789575417.370832:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.370839:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575417.370852:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.370859:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0800/0xc45cc82a22382fe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fec expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.370890:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.370892:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.370894:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575417.371039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789575417.371191:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302912:0@lo:103: 00000100:00100000:3.0:1789575417.371233:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.371262:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575417.371269:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302784:0@lo:103: 00000100:00100000:3.0:1789575417.371293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.371421:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699302656:0@lo:103: 00000100:00100000:3.0:1789575417.371446:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.371661:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.371755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302400 00000100:00100000:2.0:1789575417.371765:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302400 00010000:00010000:2.0:1789575417.371801:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 17 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.371821:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302912 00000100:00100000:2.0:1789575417.371823:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302912 00010000:00010000:2.0:1789575417.371831:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 18 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.371840:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302784 00000100:00100000:2.0:1789575417.371842:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302784 00010000:00010000:2.0:1789575417.371850:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 19 pid: 5857 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.371857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302656 00000100:00100000:2.0:1789575417.371859:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302656 00010000:00010000:2.0:1789575417.371876:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 20 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.371895:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575417.371903:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+20:3307:x1876505699302400:12345-0@lo:103: 00010000:00010000:2.0:1789575417.371917:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575417.371923:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 20 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372087:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 20 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372106:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575417.372155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+20:3307:x1876505699302400:12345-0@lo:103: Request processed in 252us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.372163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575417.372177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575417.372183:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699302912:12345-0@lo:103: 00010000:00010000:2.0:1789575417.372190:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575417.372194:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 19 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372204:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 19 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372213:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575417.372233:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699302912:12345-0@lo:103: Request processed in 50us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.372238:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575417.372249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575417.372255:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+18:3307:x1876505699302784:12345-0@lo:103: 00010000:00010000:2.0:1789575417.372263:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575417.372266:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 18 pid: 5857 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372273:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 18 pid: 5857 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372281:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575417.372302:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+18:3307:x1876505699302784:12345-0@lo:103: Request processed in 48us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.372307:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575417.372325:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575417.372331:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+17:3309:x1876505699302656:12345-0@lo:103: 00010000:00010000:2.0:1789575417.372339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575417.372344:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 17 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372352:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 17 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.372361:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575417.373264:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+17:3309:x1876505699302656:12345-0@lo:103: Request processed in 929us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.373274:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575417.373336:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699302656:0@lo:103: 00000100:00100000:2.0:1789575417.373388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302784:0@lo:103: 00000100:00100000:2.0:1789575417.373397:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302912:0@lo:103: 00000100:00100000:2.0:1789575417.373405:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699302400:0@lo:103: 00000100:00100000:2.0:1789575417.373772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699302528 00000100:00100000:2.0:1789575417.373779:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699302528 00010000:00010000:2.0:1789575417.373805:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 17 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.373877:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789575417.374089:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0a00/0xc45cc82a22382fec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382fe5 expref: 17 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.374118:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699301760:0@lo:104: 00010000:00010000:0.0:1789575417.374132:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030800/0xc45cc82a22382fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382fbb expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.374139:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699301888:0@lo:104: 00000100:00100000:0.0:1789575417.374147:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302016:0@lo:104: 00010000:00010000:0.0:1789575417.374154:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1c00/0xc45cc82a22382f7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382f75 expref: 15 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.374162:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302144:0@lo:104: 00010000:00010000:0.0:1789575417.374170:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2156400/0xc45cc82a22382f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382f4b expref: 14 pid: 5857 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.374178:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5856:1876505699302272:0@lo:104: 00010000:00010000:0.0:1789575417.374202:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.374315:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+13:3308:x1876505699302528:12345-0@lo:103: 00010000:00010000:2.0:1789575417.374332:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575417.374337:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374359:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374407:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1000/0xc45cc82a22382fa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382f9f expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374422:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374431:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374447:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374455:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374461:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374468:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374474:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575417.374478:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374487:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374516:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.374527:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575417.374579:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+12:3308:x1876505699302528:12345-0@lo:103: Request processed in 693us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.374586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789575417.374663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699302528:0@lo:103: 00010000:00010000:0.0:1789575417.374743:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.374752:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.374759:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031800/0xc45cc82a22383001 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789575417.374772:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789575417.461465:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+11:7649:x1876505699301632:12345-0@lo:253: Request processed in 133663us (134556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.461485:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789575417.461636:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699301632:0@lo:253: 10000000:01000000:2.0:1789575417.461660:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789575417.461664:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575417.461666:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789575417.461668:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575417.461669:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789575417.461671:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575417.461673:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575417.461674:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575417.461676:0:7649:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789575417.461679:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575417.461681:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789575417.461709:0:7649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e95850a0800 from lustre-OST0001 10000000:01000000:2.0:1789575417.461741:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789575417.461744:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789575417.461755:0:7649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e96879b99c0 local copy 10000000:01000000:2.0:1789575417.461760:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789575417.461813:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.461827:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.461838:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.462018:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303040:0@lo:101: 00000100:00100000:2.0:1789575417.462057:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.462171:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303040 00000100:00100000:1.0:1789575417.462178:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303040 00000100:00100000:1.0:1789575417.462221:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789575417.462229:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+11:7649:x1876505699303040:12345-0@lo:101: 00010000:00010000:1.0:1789575417.462242:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575417.462257:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238300f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383008 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.462280:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383008 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.462290:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238300f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383008 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.462299:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1000, rc 0) 00000100:00100000:1.0:1789575417.462328:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303040:12345-0@lo:101: Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.462333:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789575417.462519:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b0d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.462536:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303040:0@lo:101: 00010000:00010000:2.0:1789575417.462549:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.462558:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.462692:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303168:0@lo:501: 00000100:00100000:2.0:1789575417.462718:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.462813:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303168 00000100:00100000:0.0:1789575417.462817:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303168 00000100:00100000:0.0:1789575417.462848:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789575417.462856:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303168:12345-0@lo:501: 00000100:00100000:0.0:1789575417.463133:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303168:12345-0@lo:501: Request processed in 276us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575417.463140:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789575417.464064:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b0d8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575417.464179:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303168:0@lo:501: 10000000:01000000:3.0:1789575417.464199:0:7649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789575417.464249:0:7649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789575417.464259:0:7649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.464270:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.464277:0:7649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.464341:0:7649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789575417.464449:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e95850a0800 10000000:01000000:3.0:1789575417.464457:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789575417.464465:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789575417.464468:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789575417.464473:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789575417.464476:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789575417.464508:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.464517:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.464526:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.464558:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303296:0@lo:101: 00000100:00100000:3.0:1789575417.464627:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.464668:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0c129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.464738:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303296 00000100:00100000:0.0:1789575417.464746:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303296 00000100:00100000:0.0:1789575417.464797:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789575417.464806:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303296:12345-0@lo:101: 00010000:00010000:0.0:1789575417.464817:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575417.464832:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383016 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.464853:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.465000:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.465010:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031800, rc 0) 00000100:00100000:0.0:1789575417.465051:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699303296:12345-0@lo:101: Request processed in 246us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575417.465057:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1789575417.465132:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575417.465139:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.465147:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575417.465151:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.465160:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575417.465167:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575417.465172:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789575417.465193:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.465199:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575417.465227:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.465235:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2076400/0xc45cc82a22383008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc45cc82a2238300f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.465252:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.465254:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.465256:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575417.465265:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575417.465279:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699303424:0@lo:103: 00000100:00100000:1.0:1789575417.465316:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.465365:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303424 00000100:00100000:1.0:1789575417.468345:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303424 00000100:00100000:1.0:1789575417.468497:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575417.468509:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+13:3309:x1876505699303424:12345-0@lo:103: 00010000:00010000:1.0:1789575417.468530:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575417.468559:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238300f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383008 expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.468582:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575417.468711:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699303424:12345-0@lo:103: Request processed in 204us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.468718:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575417.468800:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699303424:0@lo:103: 00000100:00100000:3.0:1789575417.473197:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303296:0@lo:101: 00010000:00010000:3.0:1789575417.473229:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.473241:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.473406:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303552:0@lo:501: 00000100:00100000:3.0:1789575417.473474:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.473519:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0c129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.474461:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303552 00000100:00100000:1.0:1789575417.474473:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303552 00000100:00100000:1.0:1789575417.474530:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789575417.474539:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303552:12345-0@lo:501: 00000100:00100000:1.0:1789575417.475168:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303552:12345-0@lo:501: Request processed in 628us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.475176:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789575417.476102:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303552:0@lo:501: 00000100:00100000:3.0:1789575417.476159:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303680:0@lo:503: 00000100:00100000:3.0:1789575417.476220:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.476301:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0c129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.480210:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303680 00000100:00100000:1.0:1789575417.480232:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303680 00000100:00100000:1.0:1789575417.480350:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789575417.480360:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303680:12345-0@lo:503: 00000100:00100000:1.0:1789575417.480705:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303680:12345-0@lo:503: Request processed in 344us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.480714:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789575417.482306:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303680:0@lo:503: 00000040:00080000:3.0:1789575417.482878:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575417.483068:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303808:0@lo:502: 00000100:00100000:3.0:1789575417.483146:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.489271:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b681c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.489452:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303808 00000100:00100000:0.0:1789575417.489468:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303808 00000100:00100000:0.0:1789575417.489553:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789575417.489565:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303808:12345-0@lo:502: 00000100:00100000:0.0:1789575417.492773:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303808:12345-0@lo:502: Request processed in 3192us (9609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575417.492794:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789575417.493159:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303808:0@lo:502: 00000040:00080000:3.0:1789575417.493564:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789575417.493650:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789575417.493683:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789575417.493725:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789575417.493762:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789575417.493795:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789575417.493859:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303936:0@lo:502: 00000100:00100000:3.0:1789575417.493937:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.493982:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0c129c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.494096:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699303936 00000100:00100000:0.0:1789575417.494104:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699303936 00000100:00100000:0.0:1789575417.494148:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789575417.494158:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303936:12345-0@lo:502: 00000100:00100000:0.0:1789575417.494431:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699303936:12345-0@lo:502: Request processed in 272us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575417.494439:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789575417.499543:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699303936:0@lo:502: 00000040:00080000:3.0:1789575417.499782:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789575417.499798:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789575417.502000:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789575417.502013:0:7654:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789575417.502020:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575417.502023:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789575417.502031:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575417.502049:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e9699e63380) 00000020:00000080:1.0:1789575417.502073:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789575417.502081:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789575417.502161:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e95850a0800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789575417.502169:0:7654:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789575417.502176:0:7654:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc45cc82a2238302b 00010000:00010000:1.0:1789575417.512252:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1789575417.513281:0:7654:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789575417.526572:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789575417.529155:0:7654:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789575417.536072:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789575417.536683:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789575417.541438:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789575417.541468:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575417.541480:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575417.541483:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789575417.541487:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575417.541493:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575417.541494:0:7654:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789575417.541497:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789575417.541499:0:7654:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789575417.541590:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575417.541594:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575417.541607:0:7654:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789575417.541620:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789575417.542192:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789575417.542227:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789575417.542256:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.542270:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575417.542282:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e95850a0800 from 1 10000000:01000000:1.0:1789575417.542286:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789575417.542345:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.542354:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.542366:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575417.542446:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304064:0@lo:101: 00000100:00100000:1.0:1789575417.544406:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.544460:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.547199:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304064 00000100:00100000:0.0:1789575417.547215:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304064 00000100:00100000:0.0:1789575417.547274:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789575417.547285:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+12:7649:x1876505699304064:12345-0@lo:101: 00010000:00010000:0.0:1789575417.547303:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575417.547324:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383032 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.547363:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383032 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.547392:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383032 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.547400:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030800, rc 0) 00000100:00100000:0.0:1789575417.551306:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304064:12345-0@lo:101: Request processed in 4002us (6884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575417.551326:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789575417.552184:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304064:0@lo:101: 00010000:00010000:1.0:1789575417.552226:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.552247:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575417.552489:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304192:0@lo:501: 00000100:00100000:1.0:1789575417.552568:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.552618:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575417.554171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304192 00000100:00100000:3.0:1789575417.554185:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304192 00000100:00100000:3.0:1789575417.554243:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789575417.554252:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304192:12345-0@lo:501: 00000100:00100000:3.0:1789575417.554589:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304192:12345-0@lo:501: Request processed in 338us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.554597:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789575417.555087:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304192:0@lo:501: 00000100:00100000:1.0:1789575417.555136:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304320:0@lo:503: 00000100:00100000:1.0:1789575417.555187:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.555226:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575417.556557:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304320 00000100:00100000:3.0:1789575417.556569:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304320 00000100:00100000:3.0:1789575417.556622:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789575417.556632:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304320:12345-0@lo:503: 00000100:00100000:3.0:1789575417.561702:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304320:12345-0@lo:503: Request processed in 5056us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.561719:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789575417.566861:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304320:0@lo:503: 00000040:00080000:0.0:1789575417.567309:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789575417.567435:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304448:0@lo:502: 00000100:00100000:0.0:1789575417.567539:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.567593:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.567701:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304448 00000100:00100000:2.0:1789575417.567709:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304448 00000100:00100000:2.0:1789575417.567767:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789575417.567778:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304448:12345-0@lo:502: 00000100:00100000:2.0:1789575417.568086:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304448:12345-0@lo:502: Request processed in 309us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.568096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789575417.569352:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304448:0@lo:502: 00000040:00080000:0.0:1789575417.569836:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789575417.569924:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789575417.569997:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304576:0@lo:502: 00000100:00100000:0.0:1789575417.570080:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.570134:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.571004:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304576 00000100:00100000:2.0:1789575417.571018:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304576 00000100:00100000:2.0:1789575417.571080:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789575417.571090:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304576:12345-0@lo:502: 00000100:00100000:2.0:1789575417.571345:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304576:12345-0@lo:502: Request processed in 256us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.571353:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789575417.571604:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304576:0@lo:502: 00000040:00080000:0.0:1789575417.571775:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789575417.571791:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789575417.576604:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575417.576659:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575417.576663:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789575417.576673:0:7658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e95850a0800 00000020:00000080:0.0:1789575417.576675:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789575417.576713:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575417.576717:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575417.576718:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789575417.576722:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789575417.581247:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789575417.581292:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575417.581355:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.581396:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575417.581474:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789575417.581477:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e95850a0800 10000000:01000000:2.0:1789575417.581480:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e95850a0800 10000000:01000000:2.0:1789575417.581485:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789575417.581491:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e95850a0800 from 1 10000000:01000000:2.0:1789575417.581493:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789575417.581533:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.581542:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.581554:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575417.581578:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304704:0@lo:101: 00000100:00100000:2.0:1789575417.581671:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.581717:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534780 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.582188:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304704 00000100:00100000:1.0:1789575417.582198:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304704 00000100:00100000:1.0:1789575417.582256:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789575417.582265:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699304704:12345-0@lo:101: 00010000:00010000:1.0:1789575417.582279:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575417.582293:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383040 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.582320:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383040 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.582339:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383040 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.582348:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575417.582427:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699304704:12345-0@lo:101: Request processed in 163us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.582433:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789575417.582625:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304704:0@lo:101: 00010000:00010000:3.0:1789575417.582642:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.582659:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.582782:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304832:0@lo:501: 00000100:00100000:3.0:1789575417.582814:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.582832:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9682f4d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.583065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304832 00000100:00100000:1.0:1789575417.583069:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304832 00000100:00100000:1.0:1789575417.583106:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789575417.583113:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699304832:12345-0@lo:501: 00000100:00100000:1.0:1789575417.583359:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699304832:12345-0@lo:501: Request processed in 245us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.583367:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789575417.585564:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304832:0@lo:501: 00000100:00100000:3.0:1789575417.585663:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304960:0@lo:503: 00000100:00100000:3.0:1789575417.586689:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.586742:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9682f4d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.586835:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699304960 00000100:00100000:2.0:1789575417.586846:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699304960 00000100:00100000:2.0:1789575417.587074:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789575417.587086:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699304960:12345-0@lo:503: 00000100:00100000:2.0:1789575417.587312:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699304960:12345-0@lo:503: Request processed in 228us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.587320:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789575417.587665:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699304960:0@lo:503: 00000040:00080000:3.0:1789575417.588183:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575417.588262:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305088:0@lo:502: 00000100:00100000:3.0:1789575417.588310:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575417.588426:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699ec1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.588877:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305088 00000100:00100000:1.0:1789575417.588885:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305088 00000100:00100000:2.0:1789575417.589063:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789575417.589074:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699305088:12345-0@lo:502: 00000100:00100000:2.0:1789575417.589293:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699305088:12345-0@lo:502: Request processed in 221us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.589300:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789575417.589425:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305088:0@lo:502: 00000040:00080000:1.0:1789575417.589738:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789575417.590141:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789575417.590179:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789575417.590232:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789575417.590271:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789575417.590318:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789575417.590367:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789575417.590434:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789575417.590556:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789575417.590594:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789575417.590641:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789575417.590713:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789575417.590752:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789575417.590785:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789575417.590844:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789575417.590883:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789575417.590915:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789575417.591265:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789575417.591306:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789575417.591342:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789575417.591562:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789575417.591604:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789575417.591673:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789575417.591723:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789575417.591758:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789575417.591789:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789575417.591834:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789575417.591869:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789575417.592116:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789575417.592170:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789575417.592205:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789575417.592241:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789575417.592280:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789575417.592336:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789575417.592998:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789575417.593075:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789575417.593113:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789575417.593175:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305216:0@lo:502: 00000100:00100000:1.0:1789575417.593272:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.593309:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.593514:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305216 00000100:00100000:2.0:1789575417.593524:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305216 00000100:00100000:2.0:1789575417.593592:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789575417.593603:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699305216:12345-0@lo:502: 00000100:00100000:2.0:1789575417.593889:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699305216:12345-0@lo:502: Request processed in 286us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.593897:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789575417.594353:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305216:0@lo:502: 00000040:00080000:1.0:1789575417.594489:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789575417.594509:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789575417.595425:0:7659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789575417.595440:0:7659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e9699e64d40) 00000020:00000080:1.0:1789575417.595558:0:7659:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789575417.595647:0:7659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e95850a0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789575417.595652:0:7659:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e95850a0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789575417.595654:0:7659:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e95850a0800 3 00010000:00080000:1.0:1789575417.595684:0:7659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e95850a6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789575417.599350:0:7659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789575417.599873:0:7659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789575417.599929:0:7659:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789575417.599952:0:7659:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc45cc82a22383055 00000100:00080000:2.0:1789575417.599965:0:7659:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789575417.599979:0:7659:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e95850a6800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575417.600021:0:7659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9686981880 x1876505699305344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789575417.600060:0:7659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789575417.600396:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575417.600414:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699305472:0@lo:400: 00000100:00100000:1.0:1789575417.600489:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.600527:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575417.600535:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699305600:0@lo:400: 00000100:00100000:1.0:1789575417.600557:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.600582:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305472 00000100:00100000:1.0:1789575417.600589:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305472 00000100:00100000:1.0:1789575417.600635:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305600 00000100:00100000:1.0:1789575417.600638:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305600 00000100:00100000:1.0:1789575417.600660:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789575417.600668:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699305472:12345-0@lo:400: 00000100:00100000:1.0:1789575417.600717:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699305472:12345-0@lo:400: Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.600724:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789575417.600738:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575417.600744:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699305600:12345-0@lo:400: 00000100:00100000:1.0:1789575417.600775:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699305600:12345-0@lo:400: Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.600781:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789575417.600834:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb256300 x1876505699305600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575417.600846:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699305600:0@lo:400: 00010000:00080000:1.0:1789575417.600871:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bb255f80 x1876505699305472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575417.600878:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699305472:0@lo:400: 00000100:00100000:0.0:1789575417.601333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699305344:0@lo:38: 00000100:00100000:0.0:1789575417.601391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789575417.601732:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789575417.601787:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789575417.601820:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789575417.601837:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575417.601849:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789575417.601916:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789575417.601919:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789575417.601920:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575417.601922:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575417.601924:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575417.601925:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575417.601927:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575417.601928:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575417.601992:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575417.601995:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575417.601996:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575417.602000:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789575417.602002:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789575417.602004:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789575417.602005:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575417.602006:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575417.602007:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575417.602008:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575417.602009:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575417.602011:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575417.602012:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575417.602013:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575417.602014:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789575417.602035:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789575417.602046:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305728:0@lo:253: 00000100:00100000:2.0:1789575417.602089:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575417.602116:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96865073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575417.602295:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305344 00000100:00100000:1.0:1789575417.602303:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305344 00000100:00100000:1.0:1789575417.602342:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575417.602349:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699305344:12345-0@lo:38: 00010000:00080000:1.0:1789575417.602401:0:5862:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1789575417.602434:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc45cc82a2238305c 00000004:00100000:1.0:1789575417.602450:0:5862:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789575417.602494:0:5862:0:(import.c:65:import_set_state_nolock()) ffff8e95850a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575417.602547:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876505699305344:12345-0@lo:38: Request processed in 196us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.602554:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789575417.602597:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9686981880 x1876505699305344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575417.602606:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789575417.602627:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789575417.602637:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789575417.602642:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789575417.602644:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e95850a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789575417.602650:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699305344:0@lo:38: 00000100:00100000:0.0:1789575417.602955:0:7660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876505699305856:0@lo:901: 00000100:00100000:0.0:1789575417.602995:0:7660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.603021:0:7660:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575417.603557:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305856 00000100:00100000:2.0:1789575417.603567:0:5873:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305856 00000100:00100000:2.0:1789575417.603627:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789575417.603636:0:5873:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876505699305856:12345-0@lo:901: 00000100:00080000:1.0:1789575417.604148:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575417.604713:0:5873:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876505699305856:12345-0@lo:901: Request processed in 1072us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575417.604724:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789575417.605067:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e968660dc00 x1876505699305856/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789575433 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575417.605085:0:7660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876505699305856:0@lo:901: 00000100:00100000:2.0:1789575417.605636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305728 00000100:00100000:2.0:1789575417.605648:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305728 00000100:00100000:2.0:1789575417.605714:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789575417.605725:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:7649:x1876505699305728:12345-0@lo:253: 20000000:01000000:2.0:1789575417.605769:0:5856:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789575417.605790:0:5856:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789575417.659702:0:5856:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789575417.659720:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789575417.662485:0:5878:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789575417.662501:0:5878:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789575417.662537:0:5878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.662570:0:5878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382fad expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.662581:0:5878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.662648:0:5878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575417.662689:0:5878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 14 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.662709:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699305984:0@lo:104: 00000100:00100000:0.0:1789575417.662807:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575417.663094:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699305984 00000100:00100000:1.0:1789575417.663103:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699305984 00000100:00100000:1.0:1789575417.663171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789575417.663181:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699305984:12345-0@lo:104: 00010000:00010000:1.0:1789575417.663193:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663248:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789575417.663255:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:5878:x1876505699305984:12345-0@lo:104: Request processed in 76us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.663263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789575417.663288:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575417.663294:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663301:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575417.663306:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663315:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575417.663323:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575417.663328:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789575417.663360:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663402:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575417.663426:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663433:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22382fad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382fb4 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575417.663452:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.663453:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575417.663467:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575417.663490:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699306112:0@lo:103: 00000100:00100000:1.0:1789575417.663526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575417.664155:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575417.664187:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5878:1876505699305984:0@lo:104: 00010000:00010000:0.0:1789575417.664211:0:5878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.665502:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306112 00000100:00100000:3.0:1789575417.665520:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306112 00010000:00010000:3.0:1789575417.665568:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 15 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575417.665627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789575417.665639:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+15:3307:x1876505699306112:12345-0@lo:103: 00010000:00010000:3.0:1789575417.665660:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575417.665683:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 15 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665698:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 15 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665719:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030a00/0xc45cc82a22382fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382fad expref: 15 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665742:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665752:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789575417.665773:0:5847:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013530075s 00010000:00010000:3.0:1789575417.665778:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665788:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665796:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665802:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665809:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575417.665814:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665824:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665849:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.665861:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575417.666131:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+14:3307:x1876505699306112:12345-0@lo:103: Request processed in 494us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575417.666140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789575417.666203:0:5878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.666212:0:5878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575417.666220:0:5878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031600/0xc45cc82a22383063 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575417.666311:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699306112:0@lo:103: 00000100:00100000:1.0:1789575417.672337:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:7649:x1876505699305728:12345-0@lo:253: Request processed in 66601us (70233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575417.672354:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789575417.672732:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:30b00971-c2a0-490d-912f-6313f32cd11c:7649:1876505699305728:0@lo:253: 10000000:01000000:2.0:1789575417.672754:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789575417.672759:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575417.672761:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789575417.672763:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575417.672764:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575417.672766:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575417.672767:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575417.672768:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575417.672770:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789575417.672771:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789575417.672772:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575417.672774:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789575417.672790:0:7649:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789575417.683342:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575417.684101:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575417.684343:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575417.687838:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575417.688705:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575417.689106:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789575417.696695:0:7649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789575417.777127:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789575417.959958:0:7649:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789575417.959968:0:7649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789575417.960006:0:7649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789575417.960078:0:7649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789575417.960093:0:7649:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789575417.960127:0:7649:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1789575418.800620:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575419.818194:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575420.845206:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575421.866314:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575422.376685:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699306240:0@lo:13: 00000100:00100000:0.0:1789575422.376777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575422.376860:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306240 00000100:00100000:1.0:1789575422.376870:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306240 00000100:00100000:1.0:1789575422.376931:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575422.376941:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699306240:12345-0@lo:13: 00002000:00000024:1.0:1789575422.376996:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575422.377047:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699306240:12345-0@lo:13: Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575422.377055:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789575422.377998:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789575422.378118:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb256300 x1876505699306240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575422.378146:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699306240:0@lo:13: 00000100:00100000:1.0:1789575422.888613:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699306368:0@lo:400: 00000100:00100000:0.0:1789575422.888663:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699306752:0@lo:400: 00000100:00100000:1.0:1789575422.888841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575422.888926:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699306624:0@lo:400: 00000100:00100000:1.0:1789575422.888955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575422.888976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575422.888982:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699306496:0@lo:400: 00000100:00100000:1.0:1789575422.889001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575422.889027:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306624 00000100:00100000:1.0:1789575422.889035:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306624 00000100:00100000:1.0:1789575422.889094:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306496 00000100:00100000:1.0:1789575422.889098:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306496 00000100:00100000:1.0:1789575422.889121:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575422.889129:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699306624:12345-0@lo:400: 00000100:00100000:1.0:1789575422.889195:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699306624:12345-0@lo:400: Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575422.889203:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575422.889222:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789575422.889229:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699306496:12345-0@lo:400: 00010000:00010000:2.0:1789575422.890061:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575422.892253:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699306496:12345-0@lo:400: Request processed in 3011us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575422.892269:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789575422.893581:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e968660d500 x1876505699306496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575422.893606:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699306496:0@lo:400: 00010000:00080000:1.0:1789575422.893630:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e968660d180 x1876505699306624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575422.893639:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699306624:0@lo:400: 00000100:00100000:1.0:1789575422.893729:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306368 00000100:00100000:1.0:1789575422.893740:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306368 00000100:00100000:1.0:1789575422.893801:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789575422.893812:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:3309:x1876505699306368:12345-0@lo:400: 00000100:00100000:1.0:1789575422.893912:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:3309:x1876505699306368:12345-0@lo:400: Request processed in 101us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575422.893918:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789575422.893975:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699306368:0@lo:400: 00000100:00080000:1.0:1789575422.894004:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575422.894188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575422.896047:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306752 00000100:00100000:1.0:1789575422.896064:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306752 00000100:00100000:1.0:1789575422.896157:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789575422.896169:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699306752:12345-0@lo:400: 00000100:00080000:2.0:1789575422.896180:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575422.896281:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699306752:12345-0@lo:400: Request processed in 112us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575422.896289:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789575422.896500:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9687eab800 x1876505699306752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575422.896518:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699306752:0@lo:400: 10000000:01000000:1.0:1789575423.401297:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789575423.401306:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9683db2800 from 30 10000000:01000000:1.0:1789575423.401324:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789575423.401389:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575423.401401:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575423.401554:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575423.401593:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699306880:0@lo:101: 00000100:00100000:1.0:1789575423.401680:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575423.401735:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699ec1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.402083:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699306880 00000100:00100000:3.0:1789575423.402092:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699306880 00000100:00100000:3.0:1789575423.402163:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789575423.402173:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699306880:12345-0@lo:101: 00010000:00010000:3.0:1789575423.402187:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575423.402207:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238306a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.402231:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.402241:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.402249:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575423.402298:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699306880:12345-0@lo:101: Request processed in 126us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.402305:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789575423.402393:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699306880:0@lo:101: 00010000:00010000:3.0:1789575423.402738:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.402749:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575423.402897:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307008:0@lo:501: 00000100:00100000:2.0:1789575423.402940:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.402976:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96860c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.403033:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307008 00000100:00100000:3.0:1789575423.403039:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307008 00000100:00100000:3.0:1789575423.403074:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789575423.403082:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699307008:12345-0@lo:501: 00000100:00100000:3.0:1789575423.406629:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699307008:12345-0@lo:501: Request processed in 3539us (3680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.406641:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789575423.406705:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307008:0@lo:501: 00000100:00100000:3.0:1789575423.406775:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307136:0@lo:503: 00000100:00100000:3.0:1789575423.406841:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.406887:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.406905:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307136 00000100:00100000:3.0:1789575423.406912:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307136 00000100:00100000:3.0:1789575423.406966:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789575423.406975:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699307136:12345-0@lo:503: 00000100:00100000:3.0:1789575423.407273:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699307136:12345-0@lo:503: Request processed in 298us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.407281:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789575423.407320:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307136:0@lo:503: 00000100:00100000:3.0:1789575423.407522:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7865:1876505699307264:0@lo:502: 00000100:00100000:3.0:1789575423.407569:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.407588:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307264 00000100:00100000:3.0:1789575423.407592:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307264 00000100:00100000:3.0:1789575423.407612:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789575423.407618:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7865:x1876505699307264:12345-0@lo:502: 00000100:00100000:3.0:1789575423.407824:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:7865:x1876505699307264:12345-0@lo:502: Request processed in 205us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.407831:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789575423.407866:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.407878:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7865:1876505699307264:0@lo:502: 00000100:00100000:3.0:1789575423.407914:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7865:1876505699307392:0@lo:502: 00000100:00100000:3.0:1789575423.407946:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.407965:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307392 00000100:00100000:3.0:1789575423.407968:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307392 00000100:00100000:3.0:1789575423.407987:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789575423.407999:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:7865:x1876505699307392:12345-0@lo:502: 00000100:00100000:3.0:1789575423.408113:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:7865:x1876505699307392:12345-0@lo:502: Request processed in 114us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.408120:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789575423.408147:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.408159:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7865:1876505699307392:0@lo:502: 00000040:00080000:3.0:1789575423.408178:0:7865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789575423.408227:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789575423.408243:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575423.408253:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408265:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575423.408274:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789575423.408277:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789575423.408281:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789575423.408307:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408315:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408325:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.408338:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307520:0@lo:101: 00000100:00100000:3.0:1789575423.408364:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.408405:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.408417:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307520 00000100:00100000:3.0:1789575423.408421:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307520 00000100:00100000:3.0:1789575423.408442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789575423.408447:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699307520:12345-0@lo:101: 00010000:00010000:3.0:1789575423.408455:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575423.408467:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383078 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408491:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383078 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408502:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383078 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.408512:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1a00, rc 0) 00000100:00100000:3.0:1789575423.408546:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699307520:12345-0@lo:101: Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.408552:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789575423.411284:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307520:0@lo:101: 00010000:00010000:3.0:1789575423.411316:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.411329:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.411427:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307648:0@lo:501: 00000100:00100000:3.0:1789575423.412081:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.412135:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.412181:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307648 00000100:00100000:3.0:1789575423.412189:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307648 00000100:00100000:3.0:1789575423.412234:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789575423.412244:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699307648:12345-0@lo:501: 00000100:00100000:3.0:1789575423.412592:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699307648:12345-0@lo:501: Request processed in 339us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.412601:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789575423.415187:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307648:0@lo:501: 00000100:00100000:3.0:1789575423.415259:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307776:0@lo:503: 00000100:00100000:3.0:1789575423.415341:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.415400:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.415420:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307776 00000100:00100000:3.0:1789575423.415426:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307776 00000100:00100000:3.0:1789575423.415488:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789575423.415498:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699307776:12345-0@lo:503: 00000100:00100000:3.0:1789575423.416997:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699307776:12345-0@lo:503: Request processed in 1480us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.417009:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789575423.417514:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699307776:0@lo:503: 00000100:00100000:0.0:1789575423.418499:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7866:1876505699307904:0@lo:502: 00000100:00100000:0.0:1789575423.418592:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.418647:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001240 going to sleep for 11 seconds 00000100:00100000:2.0:1789575423.418713:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699307904 00000100:00100000:2.0:1789575423.418724:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699307904 00000100:00100000:2.0:1789575423.418786:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789575423.418800:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:7866:x1876505699307904:12345-0@lo:502: 00000100:00100000:2.0:1789575423.419542:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:7866:x1876505699307904:12345-0@lo:502: Request processed in 743us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.419554:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789575423.419675:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7866:1876505699307904:0@lo:502: 00000020:01000000:3.0:1789575423.419707:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575423.419720:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575423.419722:0:7866:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789575423.419728:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789575423.419729:0:7866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789575423.419754:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7866:1876505699308032:0@lo:502: 00000100:00100000:3.0:1789575423.419796:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.419918:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308032 00000100:00100000:3.0:1789575423.419931:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308032 00000100:00100000:3.0:1789575423.419972:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789575423.419979:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:7866:x1876505699308032:12345-0@lo:502: 00000100:00100000:3.0:1789575423.420172:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:7866:x1876505699308032:12345-0@lo:502: Request processed in 193us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.420179:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789575423.420236:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.420255:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7866:1876505699308032:0@lo:502: 00000020:01000000:3.0:1789575423.420282:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575423.420287:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575423.420289:0:7866:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789575423.420294:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789575423.420399:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789575423.420702:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789575423.420719:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.420817:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575423.420833:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789575423.420835:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9689726000 from 30 10000000:01000000:3.0:1789575423.420838:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789575423.420872:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.420938:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.420950:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.420975:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308160:0@lo:101: 00000100:00100000:3.0:1789575423.421012:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.421044:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.421069:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308160 00000100:00100000:3.0:1789575423.421074:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308160 00000100:00100000:3.0:1789575423.421117:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789575423.421187:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699308160:12345-0@lo:101: 00010000:00010000:3.0:1789575423.421204:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575423.421298:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383086 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.421341:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383086 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.421355:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383086 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.421669:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575423.421725:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308160:12345-0@lo:101: Request processed in 599us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.421733:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789575423.421791:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308160:0@lo:101: 00010000:00010000:3.0:1789575423.421808:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.421820:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.423383:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308288:0@lo:501: 00000100:00100000:3.0:1789575423.424331:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.425229:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.425269:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308288 00000100:00100000:3.0:1789575423.425279:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308288 00000100:00100000:3.0:1789575423.425354:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789575423.425364:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308288:12345-0@lo:501: 00000100:00100000:3.0:1789575423.427061:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308288:12345-0@lo:501: Request processed in 1689us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.427076:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789575423.427544:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308288:0@lo:501: 00000100:00100000:3.0:1789575423.427615:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308416:0@lo:503: 00000100:00100000:3.0:1789575423.427688:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.427721:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.427736:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308416 00000100:00100000:3.0:1789575423.427741:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308416 00000100:00100000:3.0:1789575423.427775:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789575423.427782:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308416:12345-0@lo:503: 00000100:00100000:3.0:1789575423.430603:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308416:12345-0@lo:503: Request processed in 2811us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.430620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789575423.430889:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308416:0@lo:503: 00000100:00100000:2.0:1789575423.433654:0:7867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7867:1876505699308544:0@lo:502: 00000100:00100000:2.0:1789575423.433757:0:7867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.433804:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308544 00000100:00100000:2.0:1789575423.433813:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308544 00000100:00100000:2.0:1789575423.433855:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789575423.433863:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:7867:x1876505699308544:12345-0@lo:502: 00000100:00100000:2.0:1789575423.434273:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:7867:x1876505699308544:12345-0@lo:502: Request processed in 409us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.434281:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789575423.434483:0:7867:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.434508:0:7867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7867:1876505699308544:0@lo:502: 00000100:00100000:3.0:1789575423.434573:0:7867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7867:1876505699308672:0@lo:502: 00000100:00100000:3.0:1789575423.434618:0:7867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.434643:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308672 00000100:00100000:3.0:1789575423.434647:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308672 00000100:00100000:3.0:1789575423.434674:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789575423.434681:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:7867:x1876505699308672:12345-0@lo:502: 00000100:00100000:3.0:1789575423.434828:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:7867:x1876505699308672:12345-0@lo:502: Request processed in 146us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.434834:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789575423.434866:0:7867:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96860c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.434889:0:7867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7867:1876505699308672:0@lo:502: 00000040:00080000:3.0:1789575423.434907:0:7867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789575423.435038:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789575423.435059:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575423.435068:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.435080:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575423.435090:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789575423.435093:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e9689726000 from 5 10000000:01000000:3.0:1789575423.435095:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789575423.435123:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.435450:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.435461:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575423.436289:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308800:0@lo:101: 00000100:00100000:2.0:1789575423.436361:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.436436:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cf6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.436605:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308800 00000100:00100000:3.0:1789575423.436615:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308800 00000100:00100000:3.0:1789575423.436670:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789575423.436680:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699308800:12345-0@lo:101: 00010000:00010000:3.0:1789575423.436696:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575423.436717:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1800/0xc45cc82a2238309b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383094 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.436747:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1800/0xc45cc82a2238309b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383094 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.436759:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1800/0xc45cc82a2238309b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383094 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.436767:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1800, rc 0) 00000100:00100000:3.0:1789575423.436816:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699308800:12345-0@lo:101: Request processed in 137us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.436823:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789575423.436873:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308800:0@lo:101: 00010000:00010000:3.0:1789575423.436955:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.436965:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.437021:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308928:0@lo:256: 00000100:00100000:3.0:1789575423.437053:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.437084:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.437097:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699308928 00000100:00100000:3.0:1789575423.437101:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699308928 00000100:00100000:3.0:1789575423.437127:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789575423.442044:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699308928:12345-0@lo:256: 20000000:01000000:2.0:1789575423.442082:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789575423.442107:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789575423.442111:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789575423.442570:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699308928:12345-0@lo:256: Request processed in 5424us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.442580:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789575423.443267:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699308928:0@lo:256: 10000000:01000000:3.0:1789575423.444113:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789575423.444128:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.444153:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575423.444164:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789575423.444167:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789575423.444170:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789575423.444205:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.444213:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.444223:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.444243:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309056:0@lo:101: 00000100:00100000:3.0:1789575423.444290:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.444574:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789575423.444650:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309056 00000100:00100000:0.0:1789575423.444659:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309056 00000100:00100000:0.0:1789575423.444717:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789575423.444727:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699309056:12345-0@lo:101: 00010000:00010000:0.0:1789575423.444739:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575423.444753:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223830a2 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575423.444776:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575423.444787:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575423.444795:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031400, rc 0) 00000100:00100000:0.0:1789575423.444839:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699309056:12345-0@lo:101: Request processed in 114us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575423.444845:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789575423.444902:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309056:0@lo:101: 00010000:00010000:0.0:1789575423.444916:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575423.444925:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575423.444986:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309184:0@lo:501: 00000100:00100000:0.0:1789575423.445016:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.445032:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf0010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575423.445044:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309184 00000100:00100000:0.0:1789575423.445047:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309184 00000100:00100000:0.0:1789575423.445068:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789575423.445074:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699309184:12345-0@lo:501: 00000100:00100000:0.0:1789575423.445777:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699309184:12345-0@lo:501: Request processed in 700us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575423.445786:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789575423.446507:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309184:0@lo:501: 00000100:00100000:0.0:1789575423.446551:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309312:0@lo:503: 00000100:00100000:0.0:1789575423.446612:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.446655:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.446988:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309312 00000100:00100000:3.0:1789575423.446995:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309312 00000100:00100000:3.0:1789575423.447037:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789575423.447046:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699309312:12345-0@lo:503: 00000100:00100000:3.0:1789575423.447424:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699309312:12345-0@lo:503: Request processed in 365us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.447431:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789575423.447984:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699309312:0@lo:503: 00000100:00100000:0.0:1789575423.449648:0:7868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7868:1876505699309440:0@lo:502: 00000100:00100000:0.0:1789575423.449761:0:7868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.449873:0:7868:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575423.450008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309440 00000100:00100000:3.0:1789575423.450021:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309440 00000100:00100000:3.0:1789575423.450128:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789575423.450150:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:7868:x1876505699309440:12345-0@lo:502: 00000100:00100000:3.0:1789575423.450637:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:7868:x1876505699309440:12345-0@lo:502: Request processed in 488us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.450646:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789575423.450756:0:7868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7868:1876505699309440:0@lo:502: 00000020:01000000:2.0:1789575423.450793:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789575423.450802:0:7868:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789575423.450810:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575423.450813:0:7868:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789575423.450818:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789575423.450823:0:7868:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:2.0:1789575423.450849:0:7868:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789575423.450852:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789575423.450870:0:7868:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e96bbee19c0) 00000020:00000080:2.0:1789575423.450909:0:7868:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789575423.450916:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789575423.451014:0:7868:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789575423.451021:0:7868:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789575423.451032:0:7868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a223830b7 00010000:00080000:2.0:1789575423.451071:0:7868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e96bc350000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789575423.451338:0:7868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789575423.452791:0:7868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789575423.452811:0:7868:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789575423.453642:0:7868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575423.454024:0:7868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575423.454075:0:7868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789575423.460697:0:7868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789575423.461529:0:7869:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575423.461536:0:7869:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789575423.462692:0:7868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789575423.462706:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789575423.462740:0:7868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789575423.462764:0:7868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a223830be 00000100:00080000:0.0:1789575423.462776:0:7868:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575423.462789:0:7868:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e96bc350000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575423.462848:0:7868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9687ea9c00 x1876505699309568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789575423.462873:0:7868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789575423.463188:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575423.463193:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575423.463194:0:7868:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789575423.463197:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575423.463201:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575423.463202:0:7868:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789575423.463205:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789575423.463207:0:7868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789575423.463236:0:7868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7868:1876505699309696:0@lo:502: 00000100:00100000:0.0:1789575423.463318:0:7868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.463361:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309696 00000100:00100000:0.0:1789575423.463402:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309696 00000100:00100000:0.0:1789575423.463447:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789575423.463456:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:7868:x1876505699309696:12345-0@lo:502: 00000100:00100000:0.0:1789575423.463709:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:7868:x1876505699309696:12345-0@lo:502: Request processed in 252us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575423.463717:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789575423.463773:0:7868:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968300a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789575423.463799:0:7868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:7868:1876505699309696:0@lo:502: 00000100:00100000:1.0:1789575423.464149:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699309824:0@lo:400: 00000100:00100000:1.0:1789575423.464197:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575423.464241:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575423.464247:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699310208:0@lo:400: 00000100:00100000:1.0:1789575423.464269:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575423.464296:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699309952:0@lo:400: 00000100:00100000:1.0:1789575423.464318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575423.464338:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575423.464346:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309824 00000100:00100000:2.0:1789575423.464353:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309824 00000100:00100000:2.0:1789575423.464401:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310208 00000100:00100000:2.0:1789575423.464405:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310208 00000100:00100000:2.0:1789575423.464419:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309952 00000100:00100000:2.0:1789575423.464421:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309952 00000100:00100000:2.0:1789575423.464433:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789575423.464439:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699309824:12345-0@lo:400: 00000100:00100000:2.0:1789575423.464485:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699309824:12345-0@lo:400: Request processed in 46us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.464492:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789575423.464506:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789575423.464512:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699310208:12345-0@lo:400: 00000100:00100000:2.0:1789575423.464539:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699310208:12345-0@lo:400: Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.464545:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789575423.464555:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789575423.464573:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699309952:12345-0@lo:400: 00000100:00100000:2.0:1789575423.464597:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699309952:12345-0@lo:400: Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.464601:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789575423.464745:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699310080:0@lo:400: 00000020:01000000:0.0:1789575423.464768:0:7868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575423.464776:0:7868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789575423.464777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789575423.464779:0:7868:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789575423.464787:0:7868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:1.0:1789575423.464813:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686980700 x1876505699309952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575423.464826:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699309952:0@lo:400: 00010000:00080000:1.0:1789575423.464864:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981180 x1876505699310208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575423.464874:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699310208:0@lo:400: 00010000:00080000:1.0:1789575423.464883:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981880 x1876505699309824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575423.464891:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699309824:0@lo:400: 00000100:00100000:3.0:1789575423.464929:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699309568:0@lo:8: 00000100:00100000:3.0:1789575423.464977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.465018:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310080 00000100:00100000:3.0:1789575423.465022:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310080 00000100:00100000:3.0:1789575423.465057:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699309568 00000100:00100000:3.0:1789575423.465061:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699309568 00000100:00100000:3.0:1789575423.465075:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575423.465082:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789575423.465083:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699310080:12345-0@lo:400: 00000100:00100000:2.0:1789575423.465092:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699309568:12345-0@lo:8: 00000100:00100000:3.0:1789575423.465125:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699310080:12345-0@lo:400: Request processed in 43us (347us total) trans 0 rc 0/0 00010000:00080000:2.0:1789575423.465128:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000100:00100000:3.0:1789575423.465147:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:2.0:1789575423.465154:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a223830c5 00002000:00100000:2.0:1789575423.465172:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e9585249800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789575423.465177:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789575423.465181:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:3.0:1789575423.465185:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686982d80 x1876505699310080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575423.465197:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699310080:0@lo:400: 00002000:00100000:2.0:1789575423.465304:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1789575423.465649:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789575423.465668:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789575423.465688:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.465700:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575423.465712:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789575423.465715:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e96879b99c0 from 1 10000000:01000000:3.0:1789575423.465719:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789575423.465751:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.465761:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575423.465772:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575423.465791:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699310336:0@lo:101: 00000100:00100000:3.0:1789575423.465860:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1789575423.465864:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789575423.465894:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e958524b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789575423.466224:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876505699309568:12345-0@lo:8: Request processed in 1131us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.466234:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789575423.468008:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9687ea9c00 x1876505699309568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789575433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575423.468022:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575423.468044:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789575423.468055:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789575423.468061:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789575423.468064:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e96bc350000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789575423.468084:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789575423.468090:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699309568:0@lo:8: 00000004:00080000:0.0:1789575423.468122:0:7869:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789575423.468266:0:7869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 235554894453ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789575423.479091:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310336 00000100:00100000:2.0:1789575423.479107:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310336 00000100:00100000:2.0:1789575423.489708:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789575423.489736:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699310336:12345-0@lo:101: 00010000:00010000:2.0:1789575423.489760:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575423.489786:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223830cc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575423.489847:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223830cc expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575423.489866:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223830cc expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575423.489881:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:2.0:1789575423.489989:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699310336:12345-0@lo:101: Request processed in 265us (24129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.489997:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789575423.490091:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575423.490125:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699310336:0@lo:101: 00010000:00010000:2.0:1789575423.490177:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575423.490189:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575423.490279:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699310464:0@lo:501: 00000100:00100000:2.0:1789575423.490328:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.490365:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca480 going to sleep for 11 seconds 00000100:00100000:0.0:1789575423.491695:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310464 00000100:00100000:0.0:1789575423.491714:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310464 00000100:00100000:0.0:1789575423.491787:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789575423.491800:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699310464:12345-0@lo:501: 00000100:00100000:0.0:1789575423.492529:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699310464:12345-0@lo:501: Request processed in 728us (2197us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575423.492539:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789575423.492630:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699310464:0@lo:501: 10000000:01000000:0.0:1789575423.492670:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789575423.492682:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575423.492693:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789575423.570263:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789575423.657840:0:7870:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789575423.658840:0:7870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310720:0@lo:7: 00000100:00100000:1.0:1789575423.659798:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699310592:0@lo:13: 00000100:00100000:1.0:1789575423.659929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575423.662889:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310592 00000100:00100000:0.0:1789575423.662906:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310592 00000100:00100000:0.0:1789575423.662989:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575423.662999:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699310592:12345-0@lo:13: 00002000:00000024:0.0:1789575423.663070:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00010000:00080000:1.0:1789575423.665227:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686982680 x1876505699310592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575423.665227:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699310592:12345-0@lo:13: Request processed in 2228us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575423.665242:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575423.665252:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699310592:0@lo:13: 00000100:00100000:2.0:1789575423.666995:0:7870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.667064:0:7870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777d80 going to sleep for 11 seconds 00000100:00080000:2.0:1789575423.667704:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575423.667815:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310720 00000100:00100000:3.0:1789575423.667832:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310720 00000100:00100000:3.0:1789575423.668044:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789575423.668056:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7870:x1876505699310720:12345-0@lo:7: 00002000:00080000:3.0:1789575423.688460:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789575423.688470:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789575423.691749:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7870:x1876505699310720:12345-0@lo:7: Request processed in 23683us (24749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575423.691769:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789575423.698124:0:7870:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686983480 x1876505699310720/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789575439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575423.698144:0:7870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310720:0@lo:7: 00000004:00080000:2.0:1789575423.698160:0:7870:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789575423.698203:0:7870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310848:0@lo:5: 00000100:00100000:2.0:1789575423.698265:0:7870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.698323:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310848 00000100:00100000:2.0:1789575423.698331:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310848 00000100:00100000:2.0:1789575423.698404:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575423.698413:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7870:x1876505699310848:12345-0@lo:5: 00002000:00080000:2.0:1789575423.698449:0:6706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789575423.698453:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789575423.699059:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7870:x1876505699310848:12345-0@lo:5: Request processed in 644us (791us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789575423.699094:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575423.699150:0:7870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777d80 going to sleep for 11 seconds 00010000:00080000:2.0:1789575423.699175:0:7870:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686983480 x1876505699310848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789575439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575423.699189:0:7870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310848:0@lo:5: 00000004:00080000:2.0:1789575423.699199:0:7870:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789575423.699229:0:7870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310976:0@lo:700: 00000100:00100000:2.0:1789575423.699257:0:7870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.699289:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699310976 00000100:00100000:2.0:1789575423.699293:0:6715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699310976 00000100:00100000:2.0:1789575423.699323:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789575423.699330:0:6715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7870:x1876505699310976:12345-0@lo:700: 00000100:00100000:2.0:1789575423.699361:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6715:1876505699311104:0@lo:700: 00000100:00100000:2.0:1789575423.699418:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575423.699436:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575423.699457:0:5869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311104 00000100:00100000:2.0:1789575423.699460:0:5869:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311104 00000100:00100000:2.0:1789575423.699486:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789575423.699493:0:5869:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6715:x1876505699311104:12345-0@lo:700: 00000100:00100000:2.0:1789575423.700312:0:7870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777d80 going to sleep for 11 seconds 40000000:02000000:2.0:1789575423.768608:0:5869:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789575423.780440:0:5869:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6715:x1876505699311104:12345-0@lo:700: Request processed in 80933us (81006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575423.780471:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789575423.780552:0:6715:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981c00 x1876505699311104/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789575439 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575423.780592:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6715:1876505699311104:0@lo:700: 40000000:02000000:2.0:1789575423.780606:0:6715:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789575423.882300:0:6715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7870:x1876505699310976:12345-0@lo:700: Request processed in 182958us (183030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575423.882318:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789575423.882401:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789575423.882412:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789575423.886526:0:7870:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981180 x1876505699310976/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789575439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575423.886546:0:7870:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789575423.886576:0:7870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699310976:0@lo:700: 00010000:00010000:1.0:1789575423.913456:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1789575423.928327:0:7870:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789575423.934182:0:7870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699311232:0@lo:5: 00000100:00100000:3.0:1789575423.934293:0:7870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575423.934442:0:7870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575423.934631:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311232 00000100:00100000:2.0:1789575423.934644:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311232 00000100:00100000:2.0:1789575423.934727:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575423.934738:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7870:x1876505699311232:12345-0@lo:5: 00002000:00080000:2.0:1789575423.947830:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789575423.947861:0:6708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789575423.955786:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7870:x1876505699311232:12345-0@lo:5: Request processed in 21038us (21481us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789575423.955804:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789575423.956328:0:7870:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb210380 x1876505699311232/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789575439 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575423.956347:0:7870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7870:1876505699311232:0@lo:5: 00000004:00080000:3.0:1789575423.956366:0:7870:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789575424.940263:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575425.960910:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789575426.508794:0:8012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789575426.986147:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575427.499641:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699311360:0@lo:13: 00000100:00100000:1.0:1789575427.499718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575427.499793:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311360 00000100:00100000:1.0:1789575427.499801:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311360 00000100:00100000:1.0:1789575427.499856:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789575427.499864:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699311360:12345-0@lo:13: 00002000:00000024:1.0:1789575427.499899:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575427.499942:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699311360:12345-0@lo:13: Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575427.499949:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789575427.499970:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789575427.500012:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e968660d180 x1876505699311360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575427.500032:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699311360:0@lo:13: 00010000:00010000:1.0:1789575428.008553:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575428.527398:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699311488:0@lo:400: 00000100:00100000:1.0:1789575428.527496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527565:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699312000:0@lo:400: 00000100:00100000:1.0:1789575428.527594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527640:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575428.527648:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699311872:0@lo:400: 00000100:00100000:1.0:1789575428.527705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527744:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699311616:0@lo:400: 00000100:00100000:1.0:1789575428.527769:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699312128:0@lo:400: 00000100:00100000:1.0:1789575428.527805:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527823:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575428.527829:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699311744:0@lo:400: 00000100:00100000:1.0:1789575428.527849:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575428.527885:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312000 00000100:00100000:1.0:1789575428.527894:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312000 00000100:00100000:1.0:1789575428.527958:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311616 00000100:00100000:1.0:1789575428.527961:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311616 00000100:00100000:1.0:1789575428.527973:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311744 00000100:00100000:1.0:1789575428.527975:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311744 00000100:00100000:1.0:1789575428.528005:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789575428.528014:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699312000:12345-0@lo:400: 00000100:00100000:1.0:1789575428.528081:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699312000:12345-0@lo:400: Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575428.528088:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789575428.528106:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789575428.528112:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699311616:12345-0@lo:400: 00000100:00100000:1.0:1789575428.528144:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699311616:12345-0@lo:400: Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575428.528150:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789575428.528161:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789575428.528167:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699311744:12345-0@lo:400: 00000100:00100000:1.0:1789575428.528204:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699311744:12345-0@lo:400: Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575428.528426:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789575428.528450:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311872 00000100:00100000:1.0:1789575428.528455:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311872 00000100:00100000:1.0:1789575428.528483:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312128 00000100:00100000:1.0:1789575428.528487:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312128 00000100:00100000:1.0:1789575428.528502:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575428.528507:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699311872:12345-0@lo:400: 00000100:00100000:1.0:1789575428.528556:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699311872:12345-0@lo:400: Request processed in 48us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575428.528562:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575428.528574:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575428.528580:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699312128:12345-0@lo:400: 00000100:00100000:1.0:1789575428.528607:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699312128:12345-0@lo:400: Request processed in 28us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575428.528612:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789575428.528643:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575428.528649:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789575428.528758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb210700 x1876505699311744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575428.528775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699311744:0@lo:400: 00010000:00080000:1.0:1789575428.528788:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb210e00 x1876505699311616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575428.528797:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699311616:0@lo:400: 00010000:00080000:1.0:1789575428.528806:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb211c00 x1876505699312128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575428.528827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699312128:0@lo:400: 00010000:00080000:1.0:1789575428.528873:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb213b80 x1876505699311872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575428.528881:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699311872:0@lo:400: 00010000:00080000:1.0:1789575428.528892:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb211880 x1876505699312000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575428.528900:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699312000:0@lo:400: 00000100:00100000:3.0:1789575428.529162:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699311488 00000100:00100000:3.0:1789575428.529168:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699311488 00000100:00100000:3.0:1789575428.529201:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789575428.529221:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699311488:12345-0@lo:400: 00000100:00100000:3.0:1789575428.529268:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699311488:12345-0@lo:400: Request processed in 60us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575428.529274:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789575428.529315:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699311488:0@lo:400: 00010000:00010000:2.0:1789575429.044533:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575429.044680:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699312256:0@lo:13: 00000100:00100000:2.0:1789575429.044784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575429.044898:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312256 00000100:00100000:2.0:1789575429.044906:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312256 00000100:00100000:2.0:1789575429.044958:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575429.044968:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699312256:12345-0@lo:13: 00002000:00000024:2.0:1789575429.045014:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575429.045069:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699312256:12345-0@lo:13: Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575429.045084:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789575429.045150:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981180 x1876505699312256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575429.045173:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699312256:0@lo:13: 00000001:00080000:1.0:1789575429.113756:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789575430.061546:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575431.082467:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575432.104888:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575432.625219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575432.625246:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699312384:0@lo:13: 00000100:00100000:3.0:1789575432.625330:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575432.627511:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312384 00000100:00100000:2.0:1789575432.627527:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312384 00000100:00100000:2.0:1789575432.627605:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575432.627616:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699312384:12345-0@lo:13: 00002000:00000024:2.0:1789575432.627654:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575432.627737:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699312384:12345-0@lo:13: Request processed in 122us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575432.627744:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789575432.627800:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb211f80 x1876505699312384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575432.627821:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699312384:0@lo:13: 00000100:00080000:0.0:1789575432.633983:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575433.130019:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575433.151659:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575433.151709:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676218496 00000100:00100000:3.0:1789575433.151723:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676218496 00000100:00100000:3.0:1789575433.151782:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:3.0:1789575433.151801:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1876505676218496:12345-192.168.202.32@tcp:250: 00010000:00080000:3.0:1789575433.151854:0:5856:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f9131551-6e4d-4261-8037-131b911dfc86@192.168.202.32@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1789575433.151902:0:5856:0:(genops.c:1384:class_connect()) connect: client f9131551-6e4d-4261-8037-131b911dfc86, cookie 0xc45cc82a223830da 00000100:00080000:3.0:1789575433.152203:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8e96bc3cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575433.152290:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+5:2354:x1876505676218496:12345-192.168.202.32@tcp:250: Request processed in 492us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575433.152299:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:2.0:1789575433.157696:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575433.157749:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676218624 00000100:00100000:2.0:1789575433.157762:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676218624 00000100:00100000:2.0:1789575433.157822:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:2.0:1789575433.157834:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+5:5587:x1876505676218624:12345-192.168.202.32@tcp:101: 00010000:00010000:2.0:1789575433.157850:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575433.157871:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae58bf expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.157903:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.157930:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 6 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.157941:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077c00, rc 0) 00000100:00100000:2.0:1789575433.158588:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+6:5587:x1876505676218624:12345-192.168.202.32@tcp:101: Request processed in 755us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575433.158600:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:1.0:1789575433.175930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575433.176017:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676218752 00000100:00100000:2.0:1789575433.176028:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676218752 00000100:00100000:2.0:1789575433.176085:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789575433.176104:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+6:5587:x1876505676218752:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789575433.176783:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+6:5587:x1876505676218752:12345-192.168.202.32@tcp:501: Request processed in 683us (859us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789575433.176792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789575433.189136:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575433.189178:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676218880 00000100:00100000:2.0:1789575433.189190:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676218880 00000100:00100000:2.0:1789575433.189241:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:2.0:1789575433.189250:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+6:5587:x1876505676218880:12345-192.168.202.32@tcp:101: 00010000:00010000:2.0:1789575433.189270:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575433.190744:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae58c6 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.190785:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.190818:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 7 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575433.190829:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:2.0:1789575433.190903:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+7:5587:x1876505676218880:12345-192.168.202.32@tcp:101: Request processed in 1652us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575433.190913:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:2.0:1789575433.194660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575433.194709:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219008 00000100:00100000:3.0:1789575433.194727:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219008 00000100:00100000:3.0:1789575433.195215:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:3.0:1789575433.195230:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+7:5587:x1876505676219008:12345-192.168.202.32@tcp:501: 00000100:00100000:3.0:1789575433.195661:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+8:5587:x1876505676219008:12345-192.168.202.32@tcp:501: Request processed in 433us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575433.195672:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:1.0:1789575433.200986:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575433.201085:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219136 00000100:00100000:3.0:1789575433.201109:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219136 00000100:00100000:3.0:1789575433.201197:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:3.0:1789575433.201213:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+8:5587:x1876505676219136:12345-192.168.202.32@tcp:503: 00000100:00100000:3.0:1789575433.203274:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+8:5587:x1876505676219136:12345-192.168.202.32@tcp:503: Request processed in 2049us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575433.203291:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:1.0:1789575433.213985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575433.215455:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219264 00000100:00100000:0.0:1789575433.215487:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219264 00000100:00100000:0.0:1789575433.215573:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:0.0:1789575433.215585:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+8:5605:x1876505676219264:12345-192.168.202.32@tcp:502: 00000100:00100000:0.0:1789575433.216086:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+8:5605:x1876505676219264:12345-192.168.202.32@tcp:502: Request processed in 500us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.216096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:1.0:1789575433.278513:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575433.278640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219392 00000100:00100000:3.0:1789575433.278661:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219392 00000100:00100000:3.0:1789575433.278761:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:3.0:1789575433.278778:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+8:5605:x1876505676219392:12345-192.168.202.32@tcp:502: 00000100:00100000:3.0:1789575433.279441:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+8:5605:x1876505676219392:12345-192.168.202.32@tcp:502: Request processed in 665us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575433.279478:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:1.0:1789575433.289186:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575433.289566:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219520 00000100:00100000:0.0:1789575433.289586:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219520 00000100:00100000:0.0:1789575433.289686:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:0.0:1789575433.289702:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+8:5587:x1876505676219520:12345-192.168.202.32@tcp:101: 00010000:00010000:0.0:1789575433.289722:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575433.289746:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680031c00/0xc45cc82a223830ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae58f0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575433.289778:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031c00/0xc45cc82a223830ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f0 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575433.289790:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680031c00/0xc45cc82a223830ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f0 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575433.289817:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031c00, rc 0) 00000100:00100000:0.0:1789575433.289902:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:5587:x1876505676219520:12345-192.168.202.32@tcp:101: Request processed in 207us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.289909:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:3.0:1789575433.293503:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575433.294027:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219648 00000100:00100000:1.0:1789575433.294044:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219648 00000100:00100000:1.0:1789575433.294139:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:1.0:1789575433.294162:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:5587:x1876505676219648:12345-192.168.202.32@tcp:256: 20000000:01000000:1.0:1789575433.294196:0:5857:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789575433.294231:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789575433.294235:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789575433.294239:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789575433.294243:0:5857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789575433.305112:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:5587:x1876505676219648:12345-192.168.202.32@tcp:256: Request processed in 10930us (11608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575433.305132:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:2.0:1789575433.313865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575433.314431:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219776 00000100:00100000:1.0:1789575433.314441:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219776 00000100:00100000:1.0:1789575433.314530:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:1.0:1789575433.314541:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:5587:x1876505676219776:12345-192.168.202.32@tcp:101: 00010000:00010000:1.0:1789575433.314566:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575433.314589:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae58f7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575433.314625:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575433.314638:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575433.314648:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:1.0:1789575433.314715:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:5587:x1876505676219776:12345-192.168.202.32@tcp:101: Request processed in 176us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575433.314722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:1.0:1789575433.328418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575433.329290:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676219904 00000100:00100000:2.0:1789575433.329310:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676219904 00000100:00100000:2.0:1789575433.329437:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:2.0:1789575433.329453:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5587:x1876505676219904:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789575433.330456:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5587:x1876505676219904:12345-192.168.202.32@tcp:501: Request processed in 996us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575433.330483:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:0.0:1789575433.333733:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575433.333787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220032 00000100:00100000:0.0:1789575433.333806:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220032 00000100:00100000:0.0:1789575433.333874:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:0.0:1789575433.333887:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:5587:x1876505676220032:12345-192.168.202.32@tcp:503: 00000100:00100000:0.0:1789575433.334871:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:5587:x1876505676220032:12345-192.168.202.32@tcp:503: Request processed in 981us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.334884:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789575433.349020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575433.349122:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220160 00000100:00100000:0.0:1789575433.349137:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220160 00000100:00100000:0.0:1789575433.349204:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:0.0:1789575433.349216:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5611:x1876505676220160:12345-192.168.202.32@tcp:502: 00000100:00100000:0.0:1789575433.349631:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5611:x1876505676220160:12345-192.168.202.32@tcp:502: Request processed in 415us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.349641:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:1.0:1789575433.351985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575433.352148:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220288 00000100:00100000:0.0:1789575433.352162:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220288 00000100:00100000:0.0:1789575433.352233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:0.0:1789575433.352245:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:5611:x1876505676220288:12345-192.168.202.32@tcp:502: 00000100:00100000:0.0:1789575433.352597:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:5611:x1876505676220288:12345-192.168.202.32@tcp:502: Request processed in 352us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.352616:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:0.0:1789575433.360263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575433.360666:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220416 00000100:00100000:3.0:1789575433.360682:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220416 00000100:00100000:3.0:1789575433.360749:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789575433.360762:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1876505676220416:12345-192.168.202.32@tcp:38: 00010000:00080000:3.0:1789575433.360969:0:5863:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1789575433.361037:0:5863:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a223830fd 00000004:00100000:3.0:1789575433.361077:0:5863:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789575433.361085:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789575433.445718:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8e96bc3cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575433.445903:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676220416:12345-192.168.202.32@tcp:38: Request processed in 85140us (85665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575433.445917:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:2.0:1789575433.641671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699312768:0@lo:400: 00000100:00100000:2.0:1789575433.641763:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575433.641860:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789575433.641867:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699312640:0@lo:400: 00000100:00100000:2.0:1789575433.641902:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575433.641919:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699313152:0@lo:400: 00000100:00100000:2.0:1789575433.641953:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575433.642229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699312512:0@lo:400: 00000100:00100000:3.0:1789575433.642278:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575433.642315:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699313024:0@lo:400: 00000100:00100000:3.0:1789575433.642356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575433.642399:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575433.642406:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699312896:0@lo:400: 00000100:00100000:3.0:1789575433.642430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575433.643527:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312768 00000100:00100000:1.0:1789575433.643548:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312768 00000100:00100000:1.0:1789575433.643645:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312640 00000100:00100000:1.0:1789575433.643650:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312640 00000100:00100000:1.0:1789575433.643668:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313024 00000100:00100000:1.0:1789575433.643670:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313024 00000100:00100000:1.0:1789575433.643692:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789575433.643703:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699312768:12345-0@lo:400: 00000100:00100000:1.0:1789575433.643826:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699312768:12345-0@lo:400: Request processed in 124us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575433.643855:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789575433.643874:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789575433.643880:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699312640:12345-0@lo:400: 00000100:00080000:0.0:1789575433.645323:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575433.645448:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313152 00000100:00100000:0.0:1789575433.645472:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313152 00000100:00100000:0.0:1789575433.645558:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312896 00000100:00100000:0.0:1789575433.645562:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312896 00000100:00100000:0.0:1789575433.645584:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575433.645593:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699313152:12345-0@lo:400: 00000100:00100000:0.0:1789575433.645703:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699313152:12345-0@lo:400: Request processed in 111us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.645711:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575433.645731:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789575433.645737:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699312896:12345-0@lo:400: 00000100:00100000:0.0:1789575433.645779:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699312896:12345-0@lo:400: Request processed in 43us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.645797:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789575433.645822:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789575433.645832:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699313024:12345-0@lo:400: 00000100:00100000:0.0:1789575433.645866:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699313024:12345-0@lo:400: Request processed in 38us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575433.645872:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789575433.646212:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789575433.646249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5b480 x1876505699312896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575433.646266:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699312896:0@lo:400: 00010000:00080000:0.0:1789575433.646299:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5aa00 x1876505699313024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575433.646307:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699313024:0@lo:400: 00000100:00100000:1.0:1789575433.646692:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699312640:12345-0@lo:400: Request processed in 2810us (4787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575433.646700:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789575433.646747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981c00 x1876505699312640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575433.646761:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699312640:0@lo:400: 00010000:00080000:1.0:1789575433.646775:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58000 x1876505699313152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575433.647122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699312512 00000100:00100000:2.0:1789575433.647130:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699312512 00000100:00100000:2.0:1789575433.647176:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789575433.647185:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699312512:12345-0@lo:400: 00000100:00100000:2.0:1789575433.647234:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699312512:12345-0@lo:400: Request processed in 50us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575433.647240:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789575433.647550:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789575433.647600:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699313152:0@lo:400: 00010000:00080000:1.0:1789575433.647627:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5b100 x1876505699312768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575433.647636:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699312768:0@lo:400: 00000100:00100000:3.0:1789575433.648036:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699312512:0@lo:400: 00010000:00010000:1.0:1789575434.152842:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575434.152895:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699313280:0@lo:13: 00000100:00100000:3.0:1789575434.152980:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575434.153158:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313280 00000100:00100000:2.0:1789575434.153168:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313280 00000100:00100000:2.0:1789575434.153217:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575434.153225:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699313280:12345-0@lo:13: 00002000:00000024:2.0:1789575434.153259:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575434.153310:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699313280:12345-0@lo:13: Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575434.153316:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789575434.153442:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd59f80 x1876505699313280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575434.153470:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699313280:0@lo:13: 00000100:00100000:3.0:1789575434.455013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575434.455126:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220544 00000100:00100000:0.0:1789575434.455138:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220544 00000100:00100000:0.0:1789575434.455228:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789575434.455241:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:0:x1876505676220544:12345-192.168.202.32@tcp:41: 00000004:00000024:0.0:1789575434.455291:0:7184:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789575434.455361:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:0:x1876505676220544:12345-192.168.202.32@tcp:41: Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575434.455368:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00080000:1.0:1789575434.455594:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575434.459142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575434.459260:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220672 00000100:00100000:2.0:1789575434.459273:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220672 00000100:00100000:2.0:1789575434.459338:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:2.0:1789575434.459349:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676220672:12345-192.168.202.32@tcp:41: 00000004:00000024:2.0:1789575434.459415:0:5864:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789575434.459508:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676220672:12345-192.168.202.32@tcp:41: Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575434.459517:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789575434.464472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575434.464766:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220800 00000100:00100000:1.0:1789575434.464784:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220800 00000100:00100000:1.0:1789575434.464891:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789575434.464904:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676220800:12345-192.168.202.32@tcp:40: 00000100:00100000:1.0:1789575434.465022:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676220800:12345-192.168.202.32@tcp:40: Request processed in 120us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575434.465029:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789575434.468823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575434.469060:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676220928 00000100:00100000:0.0:1789575434.469076:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676220928 00000100:00100000:0.0:1789575434.469156:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789575434.469169:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876505676220928:12345-192.168.202.32@tcp:8: 00010000:00080000:0.0:1789575434.469215:0:6709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1789575434.469262:0:6709:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a22383104 00002000:00100000:0.0:1789575434.469281:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 22a2b54c-4bca-4302-892e-490c3310b8b3/ffff8e9584725000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789575434.469318:0:6709:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789575434.470503:0:6709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789575434.470554:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8e9584720800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789575434.470661:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676220928:12345-192.168.202.32@tcp:8: Request processed in 1490us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575434.470671:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575434.476559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575434.478193:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221056 00000100:00100000:1.0:1789575434.478214:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221056 00000100:00100000:1.0:1789575434.478311:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:1.0:1789575434.478326:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676221056:12345-192.168.202.32@tcp:400: 00000100:00100000:1.0:1789575434.478508:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676221056:12345-192.168.202.32@tcp:400: Request processed in 185us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575434.478517:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:3.0:1789575434.478816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575434.479029:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221184 00000100:00100000:1.0:1789575434.479035:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221184 00000100:00100000:1.0:1789575434.479086:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789575434.479092:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876505676221184:12345-192.168.202.32@tcp:8: 00010000:00080000:1.0:1789575434.479134:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1789575434.479177:0:6706:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a2238310b 00002000:00100000:1.0:1789575434.479197:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22a2b54c-4bca-4302-892e-490c3310b8b3/ffff8e96bd0cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789575434.479213:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789575434.484605:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789575434.486421:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e96bd0cd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575434.486549:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676221184:12345-192.168.202.32@tcp:8: Request processed in 7450us (7787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575434.486579:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789575434.489048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575434.489537:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221312 00000100:00100000:1.0:1789575434.489555:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221312 00000100:00100000:1.0:1789575434.489645:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789575434.489660:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676221312:12345-192.168.202.32@tcp:33: 00000004:00080000:1.0:1789575434.533900:0:5865:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44129us 00000004:00200000:1.0:1789575434.573633:0:5865:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789575434.574005:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5587:x1876505676221312:12345-192.168.202.32@tcp:33: Request processed in 84342us (84967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575434.574017:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789575434.802921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575434.803070:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221440 00000100:00100000:2.0:1789575434.803082:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221440 00000100:00100000:2.0:1789575434.803190:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789575434.803222:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5628:x1876505676221440:12345-192.168.202.32@tcp:101: 00010000:00010000:2.0:1789575434.803249:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575434.803287:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9e00/0xc45cc82a22383112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5921 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803444:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803479:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803504:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575434.803569:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575434.803594:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575434.803626:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803670:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9e00/0xc45cc82a22383112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5921 expref: 8 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803704:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5921 expref: 7 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575434.803716:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:2.0:1789575434.803721:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575434.803725:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:2.0:1789575434.803798:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:5628:x1876505676221440:12345-192.168.202.32@tcp:101: Request processed in 578us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575434.803816:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00010000:00010000:0.0:1789575435.176781:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575436.201249:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789575436.302064:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00010000:00010000:0.0:1789575437.233226:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575437.255584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575437.259229:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221568 00000100:00100000:0.0:1789575437.259249:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221568 00000100:00100000:0.0:1789575437.259351:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789575437.260280:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:5681:x1876505676221568:12345-192.168.202.32@tcp:41: 00000004:00000024:0.0:1789575437.260344:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:1.0:1789575437.260740:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575437.267100:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:5681:x1876505676221568:12345-192.168.202.32@tcp:41: Request processed in 7720us (11509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575437.267122:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789575437.277229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575437.279341:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221696 00000100:00100000:2.0:1789575437.279360:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221696 00000100:00100000:2.0:1789575437.279494:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789575437.279507:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22a2b54c-4bca-4302-892e-490c3310b8b3+5:5681:x1876505676221696:12345-192.168.202.32@tcp:13: 00002000:00000024:2.0:1789575437.279555:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575437.279950:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22a2b54c-4bca-4302-892e-490c3310b8b3+5:5681:x1876505676221696:12345-192.168.202.32@tcp:13: Request processed in 444us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575437.279958:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00080000:1.0:1789575437.280414:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575437.294490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575437.294592:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221824 00000100:00100000:3.0:1789575437.294615:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221824 00000100:00100000:3.0:1789575437.294692:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789575437.294702:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5681:x1876505676221824:12345-192.168.202.32@tcp:13: 00002000:00000024:3.0:1789575437.294744:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575437.294819:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:22a2b54c-4bca-4302-892e-490c3310b8b3+6:5681:x1876505676221824:12345-192.168.202.32@tcp:13: Request processed in 118us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575437.294827:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00080000:1.0:1789575437.295266:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575437.737122:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699313408:0@lo:13: 00000100:00100000:1.0:1789575437.737211:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575437.738565:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313408 00000100:00100000:3.0:1789575437.738579:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313408 00000100:00100000:2.0:1789575437.738884:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789575437.738898:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699313408:12345-0@lo:13: 00002000:00000024:2.0:1789575437.738924:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575437.738998:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699313408:12345-0@lo:13: Request processed in 104us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575437.739005:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789575437.739046:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb211c00 x1876505699313408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575437.739065:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699313408:0@lo:13: 00000100:00080000:1.0:1789575437.740487:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575438.260861:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575438.763395:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575438.763439:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699313664:0@lo:400: 00000100:00100000:0.0:1789575438.763512:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699313536:0@lo:400: 00000100:00100000:1.0:1789575438.763558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575438.763559:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575438.763627:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313536 00000100:00100000:0.0:1789575438.763635:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313536 00000100:00100000:0.0:1789575438.763696:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789575438.763705:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699313536:12345-0@lo:400: 00000100:00100000:1.0:1789575438.767916:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313664 00000100:00100000:1.0:1789575438.767940:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313664 00000100:00100000:1.0:1789575438.768024:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789575438.768036:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699313664:12345-0@lo:400: 00000100:00100000:1.0:1789575438.768141:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699313664:12345-0@lo:400: Request processed in 107us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575438.768161:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789575438.768234:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699313664:0@lo:400: 00000100:00100000:1.0:1789575438.768305:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699313792:0@lo:400: 00000100:00100000:1.0:1789575438.768342:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575438.768425:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699313536:12345-0@lo:400: Request processed in 4710us (4853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575438.768437:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789575438.768459:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575438.768466:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699314176:0@lo:400: 00000100:00100000:1.0:1789575438.768495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575438.768522:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314176 00000100:00100000:1.0:1789575438.768525:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314176 00000100:00100000:1.0:1789575438.768565:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789575438.768571:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699314176:12345-0@lo:400: 00000100:00100000:1.0:1789575438.768603:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699314176:12345-0@lo:400: Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575438.768609:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789575438.768623:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789575438.768645:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bd0f7b80 x1876505699314176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575438.768656:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699314176:0@lo:400: 00000100:00100000:1.0:1789575438.768905:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699314048:0@lo:400: 00000100:00100000:1.0:1789575438.768933:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575438.768958:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699313536:0@lo:400: 00000100:00100000:1.0:1789575438.768970:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575438.768976:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699313920:0@lo:400: 00000100:00100000:1.0:1789575438.768999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575438.769031:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313920 00000100:00100000:1.0:1789575438.769035:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313920 00000100:00100000:1.0:1789575438.769060:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789575438.769066:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699313920:12345-0@lo:400: 00000100:00100000:1.0:1789575438.769099:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699313920:12345-0@lo:400: Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575438.769107:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789575438.769150:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bd0f7800 x1876505699313920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575438.769159:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699313920:0@lo:400: 00000100:00100000:2.0:1789575438.769543:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699313792 00000100:00100000:2.0:1789575438.769548:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699313792 00000100:00100000:2.0:1789575438.769584:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314048 00000100:00100000:2.0:1789575438.769587:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314048 00000100:00100000:2.0:1789575438.769614:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789575438.769620:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699313792:12345-0@lo:400: 00000100:00100000:2.0:1789575438.769664:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699313792:12345-0@lo:400: Request processed in 44us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575438.769670:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789575438.769682:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575438.769687:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699314048:12345-0@lo:400: 00000100:00100000:2.0:1789575438.769715:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699314048:12345-0@lo:400: Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575438.769720:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575438.770030:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699314048:0@lo:400: 00000100:00100000:2.0:1789575438.770061:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699313792:0@lo:400: 00000100:00080000:1.0:1789575438.783927:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789575438.846758:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000001:00100000:1.0:1789575438.868522:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00010000:00010000:0.0:1789575439.273567:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575439.273644:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575439.273676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699314304:0@lo:13: 00000100:00100000:3.0:1789575439.273748:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575439.273774:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314304 00000100:00100000:0.0:1789575439.273783:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314304 00000100:00100000:0.0:1789575439.273842:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789575439.273852:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699314304:12345-0@lo:13: 00002000:00000024:0.0:1789575439.273888:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575439.273940:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699314304:12345-0@lo:13: Request processed in 90us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575439.273948:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789575439.273982:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb210e00 x1876505699314304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575439.274003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699314304:0@lo:13: 00000100:00100000:0.0:1789575439.505544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575439.505602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575439.505791:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676221952 00000100:00100000:3.0:1789575439.505795:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222080 00000100:00100000:3.0:1789575439.505804:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222080 00000100:00100000:2.0:1789575439.505805:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676221952 00000100:00100000:2.0:1789575439.505865:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:2.0:1789575439.505876:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676221952:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789575439.505930:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:3.0:1789575439.505940:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676222080:12345-192.168.202.32@tcp:400: 00000100:00100000:2.0:1789575439.505966:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676221952:12345-192.168.202.32@tcp:400: Request processed in 91us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575439.505975:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:2.0:1789575439.506047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575439.506190:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222336 00000100:00100000:0.0:1789575439.506196:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575439.506197:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222336 00000100:00100000:3.0:1789575439.506299:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676222080:12345-192.168.202.32@tcp:400: Request processed in 360us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575439.506323:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789575439.506446:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222208 00000100:00100000:0.0:1789575439.506451:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222208 00000100:00080000:1.0:1789575439.507089:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789575439.507096:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575439.507100:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575439.514876:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789575439.514900:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676222336:12345-192.168.202.32@tcp:400: 00000100:00100000:2.0:1789575439.515024:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676222336:12345-192.168.202.32@tcp:400: Request processed in 135us (8975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575439.515054:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789575439.517352:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789575439.517401:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676222208:12345-192.168.202.32@tcp:400: 00000100:00100000:0.0:1789575439.517508:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676222208:12345-192.168.202.32@tcp:400: Request processed in 142us (11313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575439.517516:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00010000:00010000:1.0:1789575440.296547:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789575440.829662:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789575441.333216:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575442.344796:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575442.856729:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575442.856763:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699314432:0@lo:13: 00000100:00100000:2.0:1789575442.856861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575442.858483:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314432 00000100:00100000:2.0:1789575442.858501:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314432 00000100:00100000:2.0:1789575442.858580:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789575442.858592:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699314432:12345-0@lo:13: 00002000:00000024:2.0:1789575442.858648:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575442.858735:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699314432:12345-0@lo:13: Request processed in 143us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575442.858743:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789575442.858792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5a300 x1876505699314432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789575442.858805:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575442.858816:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699314432:0@lo:13: 00010000:00010000:0.0:1789575443.371717:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575443.881505:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575443.881539:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699314560:0@lo:400: 00000100:00100000:1.0:1789575443.881642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575443.881887:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699314688:0@lo:400: 00000100:00100000:1.0:1789575443.881990:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575443.882155:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575443.882164:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699314816:0@lo:400: 00000100:00100000:1.0:1789575443.882198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575443.882252:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699314944:0@lo:400: 00000100:00100000:1.0:1789575443.882291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575443.882334:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575443.882340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699315072:0@lo:400: 00000100:00100000:1.0:1789575443.882442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575443.882493:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699315200:0@lo:400: 00000100:00100000:1.0:1789575443.882516:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575443.885217:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314944 00000100:00100000:3.0:1789575443.885239:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314944 00000100:00100000:3.0:1789575443.885337:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315200 00000100:00100000:3.0:1789575443.885343:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315200 00000100:00100000:3.0:1789575443.885426:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789575443.885443:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575443.885444:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699314944:12345-0@lo:400: 00000100:00100000:3.0:1789575443.885622:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699314944:12345-0@lo:400: Request processed in 184us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575443.885632:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575443.885657:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789575443.885667:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bd0f5880 x1876505699314944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575443.885669:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699315200:12345-0@lo:400: 00000100:00100000:1.0:1789575443.885698:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699314944:0@lo:400: 00000100:00100000:3.0:1789575443.885735:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699315200:12345-0@lo:400: Request processed in 69us (3215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575443.885743:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789575443.885783:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd53b80 x1876505699315200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575443.885797:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699315200:0@lo:400: 00000100:00100000:2.0:1789575443.886839:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314560 00000100:00100000:2.0:1789575443.886855:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314560 00000100:00100000:2.0:1789575443.886917:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789575443.886930:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699314560:12345-0@lo:400: 00000100:00100000:2.0:1789575443.887032:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699314560:12345-0@lo:400: Request processed in 105us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575443.887040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789575443.887079:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699314560:0@lo:400: 00000100:00100000:2.0:1789575443.887120:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314688 00000100:00100000:2.0:1789575443.887128:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314688 00000100:00100000:2.0:1789575443.887172:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699314816 00000100:00100000:2.0:1789575443.887190:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699314816 00000100:00080000:1.0:1789575443.887228:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575443.887231:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315072 00000100:00100000:2.0:1789575443.887237:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315072 00000100:00080000:1.0:1789575443.887262:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575443.887278:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789575443.887302:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699314688:12345-0@lo:400: 00000100:00100000:2.0:1789575443.887366:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699314688:12345-0@lo:400: Request processed in 79us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575443.887413:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789575443.887430:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789575443.887437:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699314816:12345-0@lo:400: 00000100:00100000:2.0:1789575443.887468:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699314816:12345-0@lo:400: Request processed in 32us (5276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575443.887474:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789575443.887485:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789575443.887491:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699315072:12345-0@lo:400: 00000100:00100000:2.0:1789575443.887526:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699315072:12345-0@lo:400: Request processed in 35us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575443.887537:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789575443.890237:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699314816:0@lo:400: 00000100:00100000:1.0:1789575443.890270:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699314688:0@lo:400: 00000100:00100000:1.0:1789575443.890348:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699315072:0@lo:400: 00010000:00010000:1.0:1789575444.394269:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575444.395981:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699315328:0@lo:13: 00000100:00100000:1.0:1789575444.397201:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575444.397452:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315328 00000100:00100000:2.0:1789575444.397466:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315328 00000100:00100000:2.0:1789575444.397539:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789575444.397551:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699315328:12345-0@lo:13: 00002000:00000024:2.0:1789575444.397609:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575444.397685:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699315328:12345-0@lo:13: Request processed in 136us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575444.397693:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789575444.400082:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb210e00 x1876505699315328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575444.400123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699315328:0@lo:13: 00000100:00100000:3.0:1789575444.622050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575444.622109:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575444.622192:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222720 00000100:00100000:1.0:1789575444.622221:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222720 00000100:00100000:1.0:1789575444.622329:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:1.0:1789575444.622343:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676222720:12345-192.168.202.32@tcp:400: 00000100:00080000:3.0:1789575444.622402:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575444.622437:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575444.622477:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676222720:12345-192.168.202.32@tcp:400: Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575444.622486:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789575444.622506:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222464 00000100:00100000:2.0:1789575444.622530:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222464 00000100:00100000:2.0:1789575444.622562:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:2.0:1789575444.622569:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2358:x1876505676222464:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789575444.625763:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575444.625851:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222848 00000100:00100000:3.0:1789575444.625865:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222848 00000100:00100000:3.0:1789575444.625961:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:3.0:1789575444.625976:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676222848:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789575444.626073:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676222848:12345-192.168.202.32@tcp:400: Request processed in 101us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575444.626092:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00080000:3.0:1789575444.626118:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575444.626177:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222592 00000100:00100000:3.0:1789575444.626183:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222592 00000100:00100000:3.0:1789575444.626224:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789575444.626231:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676222592:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789575444.626265:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676222592:12345-192.168.202.32@tcp:400: Request processed in 35us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575444.626271:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00080000:3.0:1789575444.626288:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575444.628569:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2358:x1876505676222464:12345-192.168.202.32@tcp:400: Request processed in 5981us (6517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575444.630985:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000020:00000080:3.0:1789575445.126500:0:8466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc762b51b0 20000000:00000080:3.0:1789575445.126521:0:8466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96bbe6e400 uarg=0000000000000000 20000000:01000000:3.0:1789575445.126565:0:8466:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789575445.126567:0:8466:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789575445.126571:0:8466:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789575445.126577:0:8466:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789575445.126584:0:8466:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789575445.126604:0:8466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789575445.126606:0:8466:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789575445.127101:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789575445.127106:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789575445.128726:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789575445.130652:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789575445.130757:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789575445.131047:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789575445.131077:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789575445.131081:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789575445.135243:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789575445.135966:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789575445.136023:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789575445.136061:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789575445.136076:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789575445.136079:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789575445.138155:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789575445.139331:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789575445.139579:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789575445.139640:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789575445.139655:0:8466:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789575445.139658:0:8466:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789575445.145712:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789575445.150765:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789575445.151033:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789575445.151079:0:8466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1789575445.151103:0:8466:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789575445.151130:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151152:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383016 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151161:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383040 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151189:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238306a expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151932:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383078 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151942:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383086 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151949:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151956:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223830cc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151966:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151974:0:8466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.151982:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.152031:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.152048:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 9 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.152079:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315456:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575445.153496:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.153516:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.153530:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315584:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575445.153589:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.153597:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 18 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.153606:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315712:0@lo:104: 00000100:00100000:1.0:1789575445.153649:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789575445.153896:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.153904:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.153913:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315840:0@lo:104: 00000100:00100000:1.0:1789575445.153937:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789575445.154876:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.154888:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 18 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.154917:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315968:0@lo:104: 00010000:00010000:1.0:1789575445.154953:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.154961:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 18 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.154968:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316096:0@lo:104: 00010000:00010000:1.0:1789575445.154990:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.154998:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 18 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.155005:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316224:0@lo:104: 00010000:00010000:1.0:1789575445.155026:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.155034:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 18 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.155041:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316352:0@lo:104: 00010000:00010000:1.0:1789575445.155068:0:8466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575445.155075:0:8466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 18 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.155095:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316480:0@lo:104: 00000100:00100000:1.0:1789575445.155116:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96ac080600 going to sleep for 11 seconds 00000100:00100000:2.0:1789575445.159991:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789575445.160045:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.160074:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.160085:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.160095:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.160105:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.160119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315712 00000100:00100000:2.0:1789575445.160127:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315712 00000100:00100000:2.0:1789575445.160180:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315840 00000100:00100000:2.0:1789575445.160184:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315840 00000100:00100000:3.0:1789575445.164100:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:3.0:1789575445.164123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699315968 00000100:00100000:3.0:1789575445.164137:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699315968 00000100:00100000:3.0:1789575445.164472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316096 00000100:00100000:3.0:1789575445.164477:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316096 00000100:00100000:3.0:1789575445.164490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316224 00000100:00100000:3.0:1789575445.164492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316224 00000100:00100000:3.0:1789575445.164501:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316352 00000100:00100000:3.0:1789575445.164504:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316352 00000100:00100000:3.0:1789575445.164512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316480 00000100:00100000:3.0:1789575445.164514:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316480 00000100:00100000:3.0:1789575445.164530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789575445.164539:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+9:8466:x1876505699315712:12345-0@lo:104: 00010000:00010000:3.0:1789575445.164559:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575445.164664:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575445.164670:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+9:8466:x1876505699315712:12345-0@lo:104: Request processed in 133us (11021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.164677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789575445.164696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575445.164703:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+8:8466:x1876505699315840:12345-0@lo:104: 00010000:00010000:3.0:1789575445.164710:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165103:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575445.165111:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165119:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575445.165123:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165144:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575445.165151:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575445.165157:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789575445.165457:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165465:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575445.165486:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165493:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0200/0xc45cc82a223830cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830d3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.165506:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575445.165508:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575445.165510:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575445.165525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699316608:0@lo:103: 00000100:00100000:1.0:1789575445.165625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575445.165653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575445.165705:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315456:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575445.165716:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315584:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575445.165724:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315712:0@lo:104: 00010000:00010000:3.0:1789575445.166042:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575445.166051:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+8:8466:x1876505699315840:12345-0@lo:104: Request processed in 1348us (12112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.166061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575445.166121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789575445.166133:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+7:8466:x1876505699315968:12345-0@lo:104: 00010000:00010000:3.0:1789575445.166144:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166285:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575445.166294:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166302:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.166305:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166314:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.166322:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.166328:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.166386:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166401:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575445.166413:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166420:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223830a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223830a9 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166434:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.166436:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.166437:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575445.166452:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699316736:0@lo:103: 00000100:00100000:2.0:1789575445.166489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575445.166540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676222976 00000100:00100000:2.0:1789575445.166549:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676222976 00010000:00010000:2.0:1789575445.166577:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 10 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575445.166594:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223104 00000100:00100000:2.0:1789575445.166596:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223104 00010000:00010000:2.0:1789575445.166607:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 11 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575445.166616:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316736 00000100:00100000:2.0:1789575445.166619:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316736 00010000:00010000:2.0:1789575445.166630:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 19 pid: 5857 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575445.166642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575445.166647:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9131551-6e4d-4261-8037-131b911dfc86+11:2356:x1876505676222976:12345-192.168.202.32@tcp:103: 00010000:00010000:2.0:1789575445.166666:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575445.166672:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 11 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166683:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 11 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166700:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223830e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58c6 expref: 11 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.166717:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575445.166773:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676222976:12345-192.168.202.32@tcp:103: Request processed in 124us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575445.166780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575445.166795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575445.166802:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9131551-6e4d-4261-8037-131b911dfc86+9:2356:x1876505676223104:12345-192.168.202.32@tcp:103: 00010000:00010000:2.0:1789575445.166809:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575445.167015:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.167029:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.167040:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223830e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58bf expref: 9 pid: 5857 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.167050:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575445.167072:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9131551-6e4d-4261-8037-131b911dfc86+8:2356:x1876505676223104:12345-192.168.202.32@tcp:103: Request processed in 270us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575445.167085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575445.167098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789575445.167104:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699316736:12345-0@lo:103: 00010000:00010000:2.0:1789575445.167114:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575445.167119:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 19 pid: 5857 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.167127:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 19 pid: 5857 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.167136:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575445.167169:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699316736:12345-0@lo:103: Request processed in 66us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575445.167175:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789575445.167426:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699316736:0@lo:103: 00010000:00010000:3.0:1789575445.167567:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575445.167584:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+7:8466:x1876505699315968:12345-0@lo:104: Request processed in 1446us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.167593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789575445.167613:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789575445.167622:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+6:8466:x1876505699316096:12345-0@lo:104: 00010000:00010000:3.0:1789575445.167632:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575445.167668:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789575445.167673:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+6:8466:x1876505699316096:12345-0@lo:104: Request processed in 54us (7598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.167678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789575445.167691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789575445.167698:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+5:8466:x1876505699316224:12345-0@lo:104: 00010000:00010000:3.0:1789575445.167705:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575445.168520:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789575445.168529:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+5:8466:x1876505699316224:12345-0@lo:104: Request processed in 832us (8441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.168537:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789575445.168557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789575445.168564:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:8466:x1876505699316352:12345-0@lo:104: 00010000:00010000:3.0:1789575445.168574:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575445.168626:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789575445.168631:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:8466:x1876505699316352:12345-0@lo:104: Request processed in 69us (8535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.168637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789575445.168649:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789575445.168655:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:8466:x1876505699316480:12345-0@lo:104: 00010000:00010000:3.0:1789575445.168663:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575445.168687:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789575445.168692:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:8466:x1876505699316480:12345-0@lo:104: Request processed in 39us (8586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575445.168697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789575445.168979:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031400/0xc45cc82a223830a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223830a2 expref: 18 pid: 5857 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.168993:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315840:0@lo:104: 00000100:00100000:1.0:1789575445.169004:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699315968:0@lo:104: 00000100:00100000:1.0:1789575445.169011:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316096:0@lo:104: 00000100:00100000:1.0:1789575445.169018:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316224:0@lo:104: 00000100:00100000:1.0:1789575445.169025:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316352:0@lo:104: 00000100:00100000:1.0:1789575445.169031:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8466:1876505699316480:0@lo:104: 00010000:00010000:1.0:1789575445.169064:0:8466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169157:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789575445.169164:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169171:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.169175:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169183:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.169191:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.169282:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.169328:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169335:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575445.169392:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169400:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f1200/0xc45cc82a22383086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238308d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169411:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789575445.169415:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169421:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.169423:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169431:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.169437:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.169442:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.169456:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169462:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575445.169476:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.169483:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0600/0xc45cc82a22383078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238307f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575445.169635:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699316864:0@lo:103: 00000100:00100000:1.0:1789575445.169678:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575445.169717:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575445.169723:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699316992:0@lo:103: 00000100:00100000:1.0:1789575445.169958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575445.170011:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789575445.170016:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170022:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.170026:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170033:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.170039:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.170044:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.170063:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170069:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789575445.170108:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789575445.170127:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170134:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d1c00/0xc45cc82a2238306a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383071 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170145:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575445.170154:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170160:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.170163:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170171:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.170177:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.170182:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.170206:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.170211:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789575445.170281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575445.170298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575445.170305:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699317248:0@lo:103: 00000100:00100000:0.0:1789575445.170330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575445.170355:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316864 00000100:00100000:0.0:1789575445.170389:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316864 00010000:00010000:0.0:1789575445.170422:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 18 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.170457:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316992 00000100:00100000:0.0:1789575445.170460:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316992 00010000:00010000:0.0:1789575445.170473:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 19 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.170483:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699316608 00000100:00100000:0.0:1789575445.170486:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699316608 00010000:00010000:0.0:1789575445.170496:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 20 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.170506:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317248 00000100:00100000:0.0:1789575445.170508:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317248 00010000:00010000:0.0:1789575445.170519:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 21 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.170532:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789575445.170540:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+21:3308:x1876505699316864:12345-0@lo:103: 00010000:00010000:0.0:1789575445.170553:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.170558:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 21 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170568:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 21 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170583:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1000/0xc45cc82a2238308d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22383086 expref: 21 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170597:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575445.170634:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+20:3308:x1876505699316864:12345-0@lo:103: Request processed in 94us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.170651:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789575445.170670:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789575445.170676:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699316992:12345-0@lo:103: 00010000:00010000:0.0:1789575445.170684:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.170689:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 19 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170698:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 19 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170707:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1a00/0xc45cc82a2238307f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22383078 expref: 19 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170716:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575445.170757:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+18:3308:x1876505699316992:12345-0@lo:103: Request processed in 81us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.170763:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789575445.170776:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575445.170782:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+17:3306:x1876505699316608:12345-0@lo:103: 00010000:00010000:0.0:1789575445.170788:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.170793:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 17 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170801:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 17 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.170810:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223830d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223830cc expref: 17 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575445.171131:0:5847:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789575445.171142:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789575445.171301:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575445.171347:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+16:3306:x1876505699316608:12345-0@lo:103: Request processed in 565us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.171353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575445.171397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789575445.171404:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+15:3306:x1876505699317248:12345-0@lo:103: 00010000:00010000:0.0:1789575445.171412:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.171417:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 15 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.171426:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 15 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.171436:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22383040 expref: 15 pid: 5854 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.171445:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575445.171467:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+14:3306:x1876505699317248:12345-0@lo:103: Request processed in 65us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.171472:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789575445.171537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699316992:0@lo:103: 00000100:00100000:0.0:1789575445.171545:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699316864:0@lo:103: 00000100:00100000:3.0:1789575445.171653:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699317248:0@lo:103: 00000100:00100000:3.0:1789575445.171662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699316608:0@lo:103: 00000100:00100000:1.0:1789575445.172074:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699317120:0@lo:103: 00000100:00100000:1.0:1789575445.172114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575445.172206:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317120 00000100:00100000:0.0:1789575445.172213:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317120 00010000:00010000:0.0:1789575445.172235:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.172267:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789575445.172273:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+14:3307:x1876505699317120:12345-0@lo:103: 00010000:00010000:0.0:1789575445.172282:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.172287:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.172295:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.172305:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0400/0xc45cc82a22383071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238306a expref: 14 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.172315:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575445.172349:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+13:3307:x1876505699317120:12345-0@lo:103: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.172354:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1789575445.172527:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789575445.172589:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699317120:0@lo:103: 00010000:00010000:2.0:1789575445.172973:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.172983:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22383040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383047 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.172995:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.172997:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.172999:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575445.173492:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575445.173495:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575445.173496:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.173528:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.173537:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575445.173549:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.173559:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575445.173566:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575445.173572:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789575445.173628:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.173635:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575445.173655:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.173661:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a22383016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238301d expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.173676:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.173678:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575445.173680:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575445.173686:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789575445.173701:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699317376:0@lo:103: 00000100:00100000:2.0:1789575445.173770:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575445.174955:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317376 00000100:00100000:0.0:1789575445.174965:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317376 00010000:00010000:0.0:1789575445.175003:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.175047:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789575445.175055:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+13:3309:x1876505699317376:12345-0@lo:103: 00010000:00010000:0.0:1789575445.175068:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575445.175074:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175086:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175116:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031800/0xc45cc82a2238301d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22383016 expref: 13 pid: 5856 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175133:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175141:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175159:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175166:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175174:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175181:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175187:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575445.175192:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175312:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175337:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575445.175368:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575445.175494:0:8466:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.175504:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575445.175520:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383120 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575445.177151:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+12:3309:x1876505699317376:12345-0@lo:103: Request processed in 2089us (3374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575445.177162:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789575445.177317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699317376:0@lo:103: 00010000:00010000:2.0:1789575445.416633:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575446.440776:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789575446.824510:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789575446.824521:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e95850a0800 from 39 10000000:01000000:3.0:1789575446.824527:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789575446.824624:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.824637:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.824650:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575446.824679:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317504:0@lo:101: 00000100:00100000:3.0:1789575446.824772:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.824851:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.825008:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317504 00000100:00100000:2.0:1789575446.825017:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317504 00000100:00100000:2.0:1789575446.825076:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789575446.825085:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+12:5859:x1876505699317504:12345-0@lo:101: 00010000:00010000:2.0:1789575446.825097:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575446.825111:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef8e00/0xc45cc82a2238312e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383127 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.825135:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef8e00/0xc45cc82a2238312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383127 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.825146:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef8e00/0xc45cc82a2238312e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383127 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.825154:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8e00, rc 0) 00000100:00100000:2.0:1789575446.825216:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699317504:12345-0@lo:101: Request processed in 132us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.825223:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789575446.828484:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317504:0@lo:101: 00010000:00010000:0.0:1789575446.828522:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.828537:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.828657:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317632:0@lo:501: 00000100:00100000:0.0:1789575446.828734:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.828786:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.828813:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317632 00000100:00100000:3.0:1789575446.828822:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317632 00000100:00100000:3.0:1789575446.828991:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789575446.829004:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699317632:12345-0@lo:501: 00000100:00100000:3.0:1789575446.829411:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699317632:12345-0@lo:501: Request processed in 409us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.829418:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789575446.829500:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317632:0@lo:501: 00000100:00100000:0.0:1789575446.829535:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317760:0@lo:503: 00000100:00100000:0.0:1789575446.829587:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.833223:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.833747:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317760 00000100:00100000:2.0:1789575446.833757:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317760 00000100:00100000:3.0:1789575446.834124:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789575446.834137:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699317760:12345-0@lo:503: 00000100:00100000:3.0:1789575446.834416:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699317760:12345-0@lo:503: Request processed in 283us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.834425:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789575446.834440:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699317760:0@lo:503: 00000100:00100000:0.0:1789575446.834880:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8485:1876505699317888:0@lo:502: 00000100:00100000:0.0:1789575446.834930:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.843819:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.845840:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699317888 00000100:00100000:1.0:1789575446.845858:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699317888 00000100:00100000:1.0:1789575446.845934:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789575446.845945:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:8485:x1876505699317888:12345-0@lo:502: 00000100:00100000:1.0:1789575446.846283:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:8485:x1876505699317888:12345-0@lo:502: Request processed in 338us (11351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.846291:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789575446.846487:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8485:1876505699317888:0@lo:502: 00000100:00100000:0.0:1789575446.846726:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8485:1876505699318016:0@lo:502: 00000100:00100000:0.0:1789575446.846785:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.846814:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.846950:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318016 00000100:00100000:1.0:1789575446.846956:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318016 00000100:00100000:1.0:1789575446.846978:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789575446.846985:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:8485:x1876505699318016:12345-0@lo:502: 00000100:00100000:1.0:1789575446.847175:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:8485:x1876505699318016:12345-0@lo:502: Request processed in 190us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.847181:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789575446.856518:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8485:1876505699318016:0@lo:502: 00000040:00080000:0.0:1789575446.857527:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789575446.857894:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789575446.857922:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789575446.857934:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.857974:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575446.857987:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789575446.857990:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789575446.857994:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789575446.858051:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.858059:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.858073:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575446.858104:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318144:0@lo:101: 00000100:00100000:2.0:1789575446.858196:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.858251:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.858329:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318144 00000100:00100000:3.0:1789575446.858339:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318144 00000100:00100000:3.0:1789575446.858434:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789575446.858444:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+13:5859:x1876505699318144:12345-0@lo:101: 00010000:00010000:3.0:1789575446.858470:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575446.858485:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1e00/0xc45cc82a2238313c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383135 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.858514:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1e00/0xc45cc82a2238313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383135 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.858525:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1e00/0xc45cc82a2238313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383135 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.858535:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1e00, rc 0) 00000100:00100000:3.0:1789575446.858596:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318144:12345-0@lo:101: Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.858604:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789575446.858861:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318144:0@lo:101: 00010000:00010000:0.0:1789575446.858877:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.858886:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.858937:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318272:0@lo:501: 00000100:00100000:0.0:1789575446.858966:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.858996:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.859072:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318272 00000100:00100000:3.0:1789575446.859078:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318272 00000100:00100000:3.0:1789575446.859111:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789575446.859118:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318272:12345-0@lo:501: 00000100:00100000:3.0:1789575446.859515:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318272:12345-0@lo:501: Request processed in 396us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.859524:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789575446.859950:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318272:0@lo:501: 00000100:00100000:2.0:1789575446.859992:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318400:0@lo:503: 00000100:00100000:2.0:1789575446.860043:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.860082:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.860132:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318400 00000100:00100000:0.0:1789575446.860139:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318400 00000100:00100000:0.0:1789575446.860178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789575446.860186:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318400:12345-0@lo:503: 00000100:00100000:0.0:1789575446.860404:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318400:12345-0@lo:503: Request processed in 182us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575446.860412:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789575446.860524:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318400:0@lo:503: 00000100:00100000:1.0:1789575446.863831:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8486:1876505699318528:0@lo:502: 00000100:00100000:1.0:1789575446.863921:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575446.863968:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.864041:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318528 00000100:00100000:3.0:1789575446.864050:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318528 00000100:00100000:3.0:1789575446.864100:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789575446.864109:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:8486:x1876505699318528:12345-0@lo:502: 00000100:00100000:3.0:1789575446.864325:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+14:8486:x1876505699318528:12345-0@lo:502: Request processed in 217us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.864333:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789575446.864570:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8486:1876505699318528:0@lo:502: 00000020:01000000:1.0:1789575446.864601:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575446.864610:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575446.864612:0:8486:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789575446.864618:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789575446.864643:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8486:1876505699318656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575446.864683:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575446.864713:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.864821:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318656 00000100:00100000:3.0:1789575446.864826:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318656 00000100:00100000:3.0:1789575446.864861:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789575446.864869:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:8486:x1876505699318656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575446.865004:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+14:8486:x1876505699318656:12345-0@lo:502:llog_process_th.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.865010:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789575446.865153:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8486:1876505699318656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575446.865170:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575446.865174:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575446.865176:0:8486:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789575446.865179:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789575446.865325:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789575446.865354:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789575446.865364:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.865418:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575446.865430:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789575446.865433:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9683db2800 from 39 10000000:01000000:2.0:1789575446.865436:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789575446.865467:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.865476:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.865486:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575446.865501:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.865534:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.865555:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.865805:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318784 00000100:00100000:0.0:1789575446.865812:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318784 00000100:00100000:0.0:1789575446.865852:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789575446.865860:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+14:5859:x1876505699318784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575446.865870:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575446.865888:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680031800/0xc45cc82a2238314a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383143 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.865912:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031800/0xc45cc82a2238314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383143 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.865922:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680031800/0xc45cc82a2238314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383143 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.865930:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031800, rc 0) 00000100:00100000:0.0:1789575446.865959:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699318784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575446.865965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789575446.866024:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575446.866037:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.866044:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575446.866090:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.866116:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.867601:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.872596:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699318912 00000100:00100000:0.0:1789575446.872615:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699318912 00000100:00100000:1.0:1789575446.872750:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789575446.872764:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699318912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575446.873121:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699318912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (7002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.873128:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789575446.873242:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699318912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.873298:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.873356:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.873419:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.873477:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319040 00000100:00100000:1.0:1789575446.873483:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319040 00000100:00100000:1.0:1789575446.873504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789575446.873510:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699319040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575446.873668:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699319040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.873676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789575446.873746:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.874166:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8487:1876505699319168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.874202:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.874224:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.874266:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319168 00000100:00100000:1.0:1789575446.874271:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319168 00000100:00100000:1.0:1789575446.874291:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789575446.874298:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:8487:x1876505699319168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575446.874520:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+15:8487:x1876505699319168:12345-0@lo:502:llog_process_th.0 Request processed in 221us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.874527:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789575446.874682:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8487:1876505699319168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.874731:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8487:1876505699319296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.874765:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.874789:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.874873:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319296 00000100:00100000:0.0:1789575446.874879:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319296 00000100:00100000:0.0:1789575446.874906:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789575446.874913:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:8487:x1876505699319296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575446.875071:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:8487:x1876505699319296:12345-0@lo:502:llog_process_th.0 Request processed in 157us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575446.875078:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789575446.875151:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8487:1876505699319296:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789575446.875172:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789575446.876968:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789575446.877010:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789575446.877024:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.877039:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575446.877082:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789575446.877085:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789575446.877088:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789575446.877141:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.877151:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.877163:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.877194:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.877262:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.877308:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.877413:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319424 00000100:00100000:2.0:1789575446.877424:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319424 00000100:00100000:2.0:1789575446.877475:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789575446.877486:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+15:5859:x1876505699319424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575446.877503:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575446.877520:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a22383158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383151 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.877549:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a22383158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383151 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.877591:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a22383158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383151 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.877601:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9e00, rc 0) 00000100:00100000:2.0:1789575446.877654:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699319424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.877661:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789575446.878547:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575446.878582:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.878594:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.878687:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.878734:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.878772:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.879083:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319552 00000100:00100000:1.0:1789575446.879093:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319552 00000100:00100000:1.0:1789575446.879146:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789575446.879156:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699319552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575446.879573:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699319552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.879582:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789575446.879866:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.879914:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.879969:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.879994:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.880053:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319680 00000100:00100000:3.0:1789575446.880060:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319680 00000100:00100000:3.0:1789575446.880102:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789575446.880111:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699319680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.880288:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699319680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.880295:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789575446.880713:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699319680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.882863:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8488:1876505699319808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575446.882975:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.883028:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b0d8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.883092:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319808 00000100:00100000:2.0:1789575446.883103:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319808 00000100:00100000:2.0:1789575446.883161:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789575446.883172:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:8488:x1876505699319808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.883467:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:8488:x1876505699319808:12345-0@lo:502:llog_process_th.0 Request processed in 296us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.883475:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789575446.883607:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8488:1876505699319808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575446.883642:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575446.883652:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575446.883654:0:8488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789575446.883659:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789575446.883687:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8488:1876505699319936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575446.883729:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575446.883765:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9691d10c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.883976:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699319936 00000100:00100000:2.0:1789575446.883982:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699319936 00000100:00100000:2.0:1789575446.884023:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789575446.884031:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:8488:x1876505699319936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.884198:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:8488:x1876505699319936:12345-0@lo:502:llog_process_th.0 Request processed in 168us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.884205:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789575446.884417:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8488:1876505699319936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575446.884441:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575446.884446:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575446.884448:0:8488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789575446.884453:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789575446.884639:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789575446.884665:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789575446.884676:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.884689:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575446.884700:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789575446.884702:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9689726000 from 39 10000000:01000000:0.0:1789575446.884705:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789575446.884733:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.884741:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.884751:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.884767:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.884800:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.884837:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.884886:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320064 00000100:00100000:3.0:1789575446.884892:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320064 00000100:00100000:3.0:1789575446.884925:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789575446.884932:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699320064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575446.884942:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575446.884955:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1400/0xc45cc82a22383166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238315f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.884980:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1400/0xc45cc82a22383166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238315f expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.885005:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1400/0xc45cc82a22383166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238315f expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.885015:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1400, rc 0) 00000100:00100000:3.0:1789575446.885047:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.885052:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789575446.885205:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575446.885217:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.885233:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.885285:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.885308:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.885329:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.885354:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320192 00000100:00100000:0.0:1789575446.885359:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320192 00000100:00100000:0.0:1789575446.885417:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789575446.885424:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.886772:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1341us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575446.886785:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789575446.889714:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.889805:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.889891:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.889956:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.890035:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320320 00000100:00100000:3.0:1789575446.890043:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320320 00000100:00100000:3.0:1789575446.890095:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789575446.890106:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.890336:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.890354:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789575446.890727:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575446.891085:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8489:1876505699320448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.891130:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.891163:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.891208:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320448 00000100:00100000:1.0:1789575446.891214:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320448 00000100:00100000:1.0:1789575446.891249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789575446.891256:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:8489:x1876505699320448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575446.891506:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:8489:x1876505699320448:12345-0@lo:502:llog_process_th.0 Request processed in 250us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.891514:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789575446.891755:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8489:1876505699320448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.891796:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8489:1876505699320576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.891831:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575446.891859:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.891934:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320576 00000100:00100000:3.0:1789575446.891939:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320576 00000100:00100000:3.0:1789575446.891973:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789575446.891980:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8489:x1876505699320576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575446.892116:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8489:x1876505699320576:12345-0@lo:502:llog_process_th.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575446.892123:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789575446.892211:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8489:1876505699320576:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789575446.892230:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789575446.892706:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789575446.892727:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575446.892737:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.892761:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575446.892771:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789575446.892774:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789575446.892777:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789575446.892805:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.892813:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.892821:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575446.892835:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.892870:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.892902:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001000 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.892951:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320704 00000100:00100000:2.0:1789575446.892956:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320704 00000100:00100000:2.0:1789575446.892990:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789575446.892998:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699320704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575446.893007:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575446.893019:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef9c00/0xc45cc82a22383174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238316d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.893042:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef9c00/0xc45cc82a22383174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238316d expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.893054:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef9c00/0xc45cc82a22383174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238316d expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575446.893063:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9c00, rc 0) 00000100:00100000:2.0:1789575446.893115:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699320704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.893123:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789575446.893231:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575446.893244:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575446.893254:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575446.893305:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.893330:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.893399:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001000 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.893467:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320832 00000100:00100000:1.0:1789575446.893472:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320832 00000100:00100000:1.0:1789575446.893500:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789575446.893507:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699320832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575446.893915:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699320832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.893923:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789575446.894281:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.894359:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.894438:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.894518:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001000 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.899215:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699320960 00000100:00100000:0.0:1789575446.899238:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699320960 00000100:00100000:1.0:1789575446.899435:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789575446.899448:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699320960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575446.899764:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699320960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 319us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.899773:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789575446.900142:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699320960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.901480:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8490:1876505699321088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575446.901572:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.901618:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575446.901689:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321088 00000100:00100000:2.0:1789575446.901698:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321088 00000100:00100000:2.0:1789575446.901747:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789575446.901758:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:8490:x1876505699321088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575446.902019:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:8490:x1876505699321088:12345-0@lo:502:llog_process_th.0 Request processed in 262us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575446.902027:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789575446.902176:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8490:1876505699321088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575446.902204:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575446.902214:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575446.902216:0:8490:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789575446.902221:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789575446.902242:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8490:1876505699321216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575446.902277:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575446.902458:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789575446.902906:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321216 00000100:00100000:0.0:1789575446.902914:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321216 00000100:00100000:0.0:1789575446.902994:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789575446.903005:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:8490:x1876505699321216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575446.903227:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:8490:x1876505699321216:12345-0@lo:502:llog_process_th.0 Request processed in 223us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575446.903234:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789575446.903359:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8490:1876505699321216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575446.903402:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575446.903408:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575446.903410:0:8490:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789575446.903415:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789575446.904261:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789575446.904282:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789575446.904293:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.904322:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575446.904334:0:5859:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789575446.904337:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e96879b99c0 from 1 10000000:01000000:0.0:1789575446.904340:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789575446.904414:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.904423:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.904433:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.904454:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699321344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.904502:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.904540:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575446.904656:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321344 00000100:00100000:1.0:1789575446.904666:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321344 00000100:00100000:1.0:1789575446.904720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789575446.904731:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699321344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575446.904745:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575446.904761:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0000/0xc45cc82a22383182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238317b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575446.904791:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0000/0xc45cc82a22383182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238317b expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575446.904803:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0000/0xc45cc82a22383182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238317b expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575446.904813:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0000, rc 0) 00000100:00100000:1.0:1789575446.904859:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699321344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575446.904875:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789575446.904964:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699321344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575446.904978:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.904986:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575446.905032:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699321472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575446.905054:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575446.905087:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575446.905153:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321472 00000100:00100000:3.0:1789575446.905157:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321472 00000100:00100000:3.0:1789575446.905175:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789575446.905181:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699321472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575446.905446:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699321472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (389us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575446.905453:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789575446.905739:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699321472:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789575446.905760:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789575446.905766:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575446.905776:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575447.464786:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575447.978025:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699321600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575447.978149:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575447.978579:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321600 00000100:00100000:0.0:1789575447.978592:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321600 00000100:00100000:0.0:1789575447.978696:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575447.978709:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699321600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575447.978759:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789575447.978854:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575447.991426:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699321600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12707us (13263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575447.991444:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789575447.992180:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5b480 x1876505699321600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575447.992213:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699321600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575448.492031:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575448.784812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575448.785218:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223232 00000100:00100000:3.0:1789575448.785232:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223232 00000100:00100000:3.0:1789575448.785304:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:3.0:1789575448.785314:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+8:5601:x1876505676223232:12345-192.168.202.32@tcp:101: 00010000:00010000:3.0:1789575448.785341:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575448.785363:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0600/0xc45cc82a22383189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5928 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575448.785424:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0600/0xc45cc82a22383189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5928 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575448.785435:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0600/0xc45cc82a22383189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5928 expref: 9 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575448.785445:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0600, rc 0) 00000100:00100000:3.0:1789575448.785509:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223232:12345-192.168.202.32@tcp:101: Request processed in 197us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575448.785532:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:1.0:1789575448.789502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575448.789597:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223360 00000100:00100000:2.0:1789575448.789607:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223360 00000100:00100000:2.0:1789575448.789666:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:2.0:1789575448.789677:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223360:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789575448.790040:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223360:12345-192.168.202.32@tcp:501: Request processed in 364us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575448.790048:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:2.0:1789575448.796101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575448.796307:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223488 00000100:00100000:1.0:1789575448.796333:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223488 00000100:00100000:1.0:1789575448.796441:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:1.0:1789575448.796454:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223488:12345-192.168.202.32@tcp:503: 00000100:00100000:1.0:1789575448.796739:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223488:12345-192.168.202.32@tcp:503: Request processed in 286us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575448.796748:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:1.0:1789575448.804654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575448.804876:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223616 00000100:00100000:3.0:1789575448.804888:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223616 00000100:00100000:3.0:1789575448.804949:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:3.0:1789575448.804959:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:6087:x1876505676223616:12345-192.168.202.32@tcp:502: 00000100:00100000:3.0:1789575448.805270:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:6087:x1876505676223616:12345-192.168.202.32@tcp:502: Request processed in 311us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575448.805279:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:3.0:1789575448.817747:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575448.818001:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223744 00000100:00100000:2.0:1789575448.818011:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223744 00000100:00100000:2.0:1789575448.818069:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 170 00000100:00100000:2.0:1789575448.818080:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:6087:x1876505676223744:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789575448.818444:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+9:6087:x1876505676223744:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 365us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575448.818462:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 170 00000100:00100000:2.0:1789575448.827753:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575448.828154:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676223872 00000100:00100000:1.0:1789575448.828170:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676223872 00000100:00100000:1.0:1789575448.828231:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:1.0:1789575448.828242:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676223872:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575448.828261:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575448.828281:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1800/0xc45cc82a22383190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae592f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575448.828316:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1800/0xc45cc82a22383190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae592f expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575448.828339:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1800/0xc45cc82a22383190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae592f expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575448.828348:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1800, rc 0) 00000100:00100000:1.0:1789575448.828502:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676223872:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 261us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575448.828532:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:1.0:1789575448.844627:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575448.845301:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224000 00000100:00100000:3.0:1789575448.845314:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224000 00000100:00100000:3.0:1789575448.845430:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:3.0:1789575448.845442:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676224000:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575448.845803:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676224000:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 362us (1191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575448.845812:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:1.0:1789575449.001934:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699321856:0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575449.002150:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699322368:0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575449.002223:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789575449.002229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699321728:0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002260:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575449.002280:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699322240:0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575449.002365:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321856 00000100:00100000:1.0:1789575449.002395:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321856 00000100:00100000:1.0:1789575449.002437:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322240 00000100:00100000:1.0:1789575449.002440:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322240 00000100:00100000:1.0:1789575449.002470:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789575449.002480:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699321856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002533:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699321856:12345-0@lo:400:kworker.0 Request processed in 54us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575449.002540:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789575449.002557:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789575449.002563:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699322240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002590:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699322240:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575449.002596:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789575449.002633:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322368 00000100:00100000:1.0:1789575449.002637:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322368 00000100:00100000:1.0:1789575449.002664:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789575449.002671:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699322368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.002702:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699322368:12345-0@lo:400:kworker.0 Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575449.002708:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789575449.003050:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575449.003054:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575449.003303:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699322240:0@lo:400:kworker.0 00000100:00100000:1.0:1789575449.003316:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699321856:0@lo:400:kworker.0 00010000:00080000:1.0:1789575449.003342:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9687ea8700 x1876505699322368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575449.003354:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699322368:0@lo:400:kworker.0 00000100:00100000:2.0:1789575449.006244:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321728 00000100:00100000:2.0:1789575449.006263:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321728 00000100:00100000:2.0:1789575449.006336:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789575449.006348:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699321728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575449.006479:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699321728:12345-0@lo:400:kworker.0 Request processed in 134us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575449.006487:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789575449.008212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699321984:0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.008312:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575449.008399:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575449.008408:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699322112:0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.008440:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575449.008482:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699321984 00000100:00100000:0.0:1789575449.008493:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699321984 00000100:00100000:0.0:1789575449.008570:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789575449.008581:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699321984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.008650:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699321984:12345-0@lo:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575449.008679:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789575449.008710:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322112 00000100:00100000:0.0:1789575449.008715:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322112 00000100:00100000:0.0:1789575449.008746:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789575449.008752:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699322112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.008788:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699322112:12345-0@lo:400:kworker.0 Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575449.008795:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789575449.009088:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575449.009093:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789575449.009130:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9687ea8380 x1876505699322112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575449.009144:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699322112:0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.009157:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699321984:0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.009260:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699321728:0@lo:400:kworker.0 00000100:00100000:0.0:1789575449.515315:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699322496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575449.515487:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575449.515676:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322496 00000100:00100000:3.0:1789575449.515692:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322496 00000100:00100000:3.0:1789575449.515772:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789575449.515783:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699322496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575449.515828:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575449.515881:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699322496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575449.515896:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789575449.516158:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc39b480 x1876505699322496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575449.516180:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699322496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575449.516391:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575449.741471:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575449.741517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575449.741546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575449.741590:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575449.741704:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224128 00000100:00100000:1.0:1789575449.741716:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224128 00000100:00100000:1.0:1789575449.741787:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:1.0:1789575449.741799:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676224128:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575449.741894:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676224128:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 97us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575449.741902:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:0.0:1789575449.742230:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224384 00000100:00100000:0.0:1789575449.742235:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224384 00000100:00100000:0.0:1789575449.742293:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224512 00000100:00100000:0.0:1789575449.742296:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224512 00000100:00100000:0.0:1789575449.742353:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575449.742360:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676224384:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575449.742436:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676224384:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 77us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575449.742443:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575449.742458:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789575449.742464:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676224512:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575449.742488:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676224512:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575449.742493:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575449.742886:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224256 00000100:00100000:3.0:1789575449.742893:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224256 00000100:00100000:3.0:1789575449.742950:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789575449.742958:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676224256:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575449.742996:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676224256:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 40us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575449.743004:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00080000:1.0:1789575449.744661:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575449.744678:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575449.744681:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789575450.562106:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789575450.768821:0:8529:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfc6a3fb0 20000000:00000080:0.0:1789575450.768851:0:8529:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96bbd13400 uarg=0000000000000000 20000000:01000000:0.0:1789575450.768926:0:8529:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789575450.768935:0:8529:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789575450.768943:0:8529:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789575450.772836:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789575450.773160:0:8529:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789575450.783201:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789575450.783259:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789575450.783324:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789575450.783343:0:8529:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789575450.786558:0:8529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786602:0:8529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786611:0:8529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786700:0:8529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383032 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786711:0:8529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786719:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786770:0:8529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786788:0:8529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 9 pid: 5856 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575450.786804:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322624:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575450.786935:0:8529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.786945:0:8529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 18 pid: 5856 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575450.786955:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322752:0@lo:104: 00000100:00100000:0.0:1789575450.787004:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789575450.787066:0:8529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.787076:0:8529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 18 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575450.787098:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322880:0@lo:104: 00000100:00100000:3.0:1789575450.787113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322752 00000100:00100000:3.0:1789575450.787132:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322752 00000100:00100000:0.0:1789575450.787141:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789575450.787174:0:8529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.787183:0:8529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 18 pid: 5854 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575450.787191:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699323008:0@lo:104: 00000100:00100000:0.0:1789575450.787216:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575450.787250:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789575450.787296:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575450.787333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699322880 00000100:00100000:3.0:1789575450.787337:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699322880 00000100:00100000:3.0:1789575450.787353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323008 00000100:00100000:3.0:1789575450.787356:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323008 00000100:00100000:3.0:1789575450.787410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789575450.787422:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+5:8529:x1876505699322752:12345-0@lo:104: 00010000:00010000:3.0:1789575450.787442:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787528:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575450.787535:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+5:8529:x1876505699322752:12345-0@lo:104: Request processed in 117us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575450.787543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789575450.787564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789575450.787571:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd182450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+4:8529:x1876505699322880:12345-0@lo:104: 00010000:00010000:3.0:1789575450.787580:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787637:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789575450.787642:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd182450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+4:8529:x1876505699322880:12345-0@lo:104: Request processed in 73us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575450.787649:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789575450.787686:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789575450.787693:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:8529:x1876505699323008:12345-0@lo:104: 00010000:00010000:3.0:1789575450.787700:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787759:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789575450.787765:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:8529:x1876505699323008:12345-0@lo:104: Request processed in 73us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575450.787771:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789575450.787795:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789575450.787802:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787810:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575450.787815:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787825:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575450.787833:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575450.787839:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789575450.787885:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787893:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575450.787925:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787933:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a22383032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383039 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787953:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575450.787957:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787964:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575450.787968:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.787976:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575450.787984:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575450.787990:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789575450.788010:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788017:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575450.788043:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788063:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22382f67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f6e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575450.788065:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699323264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575450.788095:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575450.788101:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788109:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575450.788113:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788122:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575450.788130:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575450.788135:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789575450.788146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789575450.788157:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788166:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575450.788178:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788186:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a22382f05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22382f0c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.788211:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575450.788220:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575450.788223:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575450.788229:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789575450.788236:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575450.788243:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699323392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575450.788270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575450.788319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323264 00000100:00100000:1.0:1789575450.788328:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323264 00000100:00100000:3.0:1789575450.788368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789575450.788406:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 19 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575450.788419:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699323136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575450.788441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323392 00000100:00100000:1.0:1789575450.788447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323392 00010000:00010000:1.0:1789575450.788464:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 20 pid: 5854 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575450.788475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575450.788608:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322752:0@lo:104: 00000100:00100000:0.0:1789575450.788622:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322880:0@lo:104: 00000100:00100000:0.0:1789575450.788705:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699323008:0@lo:104: 00010000:00010000:3.0:1789575450.790586:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575450.796734:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323136 00000100:00100000:0.0:1789575450.796753:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323136 00010000:00010000:0.0:1789575450.796821:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 21 pid: 5856 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575450.796858:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575450.796869:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+21:3306:x1876505699323264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575450.796885:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575450.796891:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 21 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.796902:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 21 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.796942:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076000/0xc45cc82a22382f6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382f67 expref: 21 pid: 5857 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.796961:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575450.797046:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+20:3306:x1876505699323264:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (8906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575450.797054:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575450.797076:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575450.797083:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699323392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575450.797091:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575450.797096:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 19 pid: 5854 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797104:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 19 pid: 5854 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797114:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2077e00/0xc45cc82a22382f0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22382f05 expref: 19 pid: 5854 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797137:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575450.797160:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+18:3306:x1876505699323392:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (8890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575450.797167:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575450.797180:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575450.797186:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+17:3308:x1876505699323136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575450.797193:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575450.797197:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 17 pid: 5856 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797212:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 17 pid: 5856 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797222:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030800/0xc45cc82a22383039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22383032 expref: 17 pid: 5856 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.797230:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575450.797264:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30b00971-c2a0-490d-912f-6313f32cd11c+16:3308:x1876505699323136:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (8797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575450.797271:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575450.799480:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699323392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789575450.799495:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699323264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575450.799662:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699323136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575450.802346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575450.802725:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8529:1876505699322624:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575450.802761:0:8529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575450.802950:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224640 00000100:00100000:3.0:1789575450.802959:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224640 00010000:00010000:3.0:1789575450.802994:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575450.803038:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789575450.803048:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676224640:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575450.803081:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575450.803089:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803100:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803118:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0200/0xc45cc82a223830f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f7 expref: 10 pid: 5856 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803134:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803143:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803188:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803195:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803202:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803210:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803216:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575450.803220:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803229:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803242:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575450.803253:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575450.803322:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+9:2357:x1876505676224640:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 273us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575450.803329:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00010000:00010000:0.0:1789575450.803512:0:8529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.803521:0:8529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575450.803527:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030200/0xc45cc82a22383197 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575451.624933:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789575452.397409:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789575452.397418:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e95850a0800 from 4 10000000:01000000:2.0:1789575452.397425:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789575452.397479:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575452.397493:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575452.397505:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575452.397546:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789575452.397637:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575452.397693:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.397813:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323520 00000100:00100000:3.0:1789575452.397822:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323520 00000100:00100000:3.0:1789575452.397887:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789575452.397905:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699323520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.397920:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575452.397934:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238319e expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.397960:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.397974:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.397983:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1200, rc 0) 00000100:00100000:3.0:1789575452.398030:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699323520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.398036:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789575452.398083:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.398097:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.398105:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575452.398164:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.398193:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.398209:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9586aca780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.398221:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323648 00000100:00100000:3.0:1789575452.398225:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323648 00000100:00100000:3.0:1789575452.398243:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789575452.398271:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699323648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.398560:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699323648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.398568:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789575452.398600:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.398640:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.398678:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.398692:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96829dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.398703:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323776 00000100:00100000:3.0:1789575452.398706:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323776 00000100:00100000:3.0:1789575452.398727:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789575452.398733:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699323776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.398872:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699323776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.398879:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789575452.398915:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699323776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.399116:0:8562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8562:1876505699323904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575452.399149:0:8562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.399168:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699323904 00000100:00100000:3.0:1789575452.399171:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699323904 00000100:00100000:3.0:1789575452.399191:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789575452.399196:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8562:x1876505699323904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575452.399318:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8562:x1876505699323904:12345-0@lo:502:llog_process_th.0 Request processed in 121us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.399332:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789575452.399358:0:8562:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96829dc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.399392:0:8562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8562:1876505699323904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575452.399418:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575452.399429:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575452.399432:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789575452.399439:0:8562:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e95850a0800 00000020:00000080:3.0:1789575452.399442:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789575452.399528:0:8562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8562:1876505699324032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575452.399558:0:8562:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.399579:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324032 00000100:00100000:3.0:1789575452.399583:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324032 00000100:00100000:3.0:1789575452.399603:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789575452.399609:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8562:x1876505699324032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575452.399716:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:8562:x1876505699324032:12345-0@lo:502:llog_process_th.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.399722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789575452.399749:0:8562:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.399759:0:8562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8562:1876505699324032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575452.399774:0:8562:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575452.399778:0:8562:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575452.399779:0:8562:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789575452.399782:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789575452.399828:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789575452.399849:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575452.399859:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.399875:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575452.399889:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789575452.399893:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9683db2800 from 4 10000000:01000000:3.0:1789575452.399896:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575452.399923:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.399931:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.399940:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575452.399954:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.399979:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.399992:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.400005:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324160 00000100:00100000:3.0:1789575452.400008:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324160 00000100:00100000:3.0:1789575452.400027:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789575452.400033:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699324160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.400041:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575452.400054:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223831ac expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.400074:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223831ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.400097:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223831ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.400106:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575452.400138:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.400144:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789575452.400175:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.400187:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.400196:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575452.400232:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.400254:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.400264:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.400274:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324288 00000100:00100000:3.0:1789575452.400277:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324288 00000100:00100000:3.0:1789575452.400309:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789575452.400315:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.400575:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.400582:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789575452.400613:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.400649:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.400687:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.400701:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.400715:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324416 00000100:00100000:3.0:1789575452.400719:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324416 00000100:00100000:3.0:1789575452.400742:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789575452.400748:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.419595:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 18834us (18895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.419612:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789575452.423696:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575452.424344:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8565:1876505699324544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575452.424472:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575452.424514:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324544 00000100:00100000:2.0:1789575452.424522:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324544 00000100:00100000:2.0:1789575452.424566:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789575452.424576:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:8565:x1876505699324544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575452.424806:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:8565:x1876505699324544:12345-0@lo:502:llog_process_th.0 Request processed in 230us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575452.424815:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789575452.424869:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575452.424887:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8565:1876505699324544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789575452.424911:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575452.424920:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575452.424922:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789575452.424929:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9683db2800 00000020:00000080:2.0:1789575452.424931:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789575452.425477:0:8565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8565:1876505699324672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575452.425520:0:8565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575452.425541:0:8565:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.426352:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324672 00000100:00100000:3.0:1789575452.426365:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324672 00000100:00100000:3.0:1789575452.426434:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789575452.426443:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:8565:x1876505699324672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575452.426664:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:8565:x1876505699324672:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.426672:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789575452.429743:0:8565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8565:1876505699324672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789575452.429811:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575452.429820:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575452.429823:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789575452.429827:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789575452.430183:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789575452.430207:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575452.430220:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430231:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575452.430243:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789575452.430245:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9689726000 from 4 10000000:01000000:3.0:1789575452.430326:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575452.430395:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430405:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430414:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575452.430443:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.430516:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.430557:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.430579:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324800 00000100:00100000:3.0:1789575452.430588:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324800 00000100:00100000:3.0:1789575452.430631:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789575452.430640:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699324800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.430654:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575452.430667:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223831ba expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430693:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223831ba expref: 19 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430704:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223831ba expref: 19 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430715:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575452.430753:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699324800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.430773:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789575452.430821:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.430835:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.430845:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575452.430895:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.433467:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.433511:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.433544:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699324928 00000100:00100000:3.0:1789575452.433553:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699324928 00000100:00100000:3.0:1789575452.433608:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789575452.433618:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699324928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.433908:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699324928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.433916:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789575452.433971:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699324928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.434027:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699325056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.434072:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575452.434086:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575452.434097:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325056 00000100:00100000:3.0:1789575452.434101:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325056 00000100:00100000:3.0:1789575452.434119:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789575452.434133:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699325056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.435706:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699325056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1565us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.435718:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789575452.435866:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699325056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575452.453573:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8566:1876505699325184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575452.453663:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575452.453718:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789575452.453928:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325184 00000100:00100000:0.0:1789575452.453944:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325184 00000100:00100000:0.0:1789575452.455440:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789575452.455465:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:8566:x1876505699325184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575452.455737:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:8566:x1876505699325184:12345-0@lo:502:llog_process_th.0 Request processed in 281us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575452.455746:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789575452.455820:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8566:1876505699325184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789575452.455857:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575452.455867:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575452.455870:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789575452.455879:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9689726000 00000020:00000080:0.0:1789575452.455881:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789575452.455965:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8566:1876505699325312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575452.456010:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575452.456053:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658600 going to sleep for 11 seconds 00000100:00100000:1.0:1789575452.456141:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325312 00000100:00100000:1.0:1789575452.456149:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325312 00000100:00100000:1.0:1789575452.456192:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789575452.456200:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:8566:x1876505699325312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575452.456362:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:8566:x1876505699325312:12345-0@lo:502:llog_process_th.0 Request processed in 162us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575452.456396:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789575452.457248:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:8566:1876505699325312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789575452.461421:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575452.461431:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575452.461433:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789575452.461438:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789575452.463329:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789575452.463389:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575452.463405:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575452.463418:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575452.649900:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575452.754270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575452.754542:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224768 00000100:00100000:3.0:1789575452.754554:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224768 00000100:00100000:3.0:1789575452.754889:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:3.0:1789575452.754905:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+9:5601:x1876505676224768:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575452.754933:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575452.754962:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5936 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.755006:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.755022:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 10 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575452.755032:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0200, rc 0) 00000100:00100000:3.0:1789575452.755128:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676224768:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 225us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.755136:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:3.0:1789575452.760066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575452.760195:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676224896 00000100:00100000:0.0:1789575452.760208:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676224896 00000100:00100000:0.0:1789575452.760270:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:0.0:1789575452.760282:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676224896:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575452.760671:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676224896:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 389us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575452.760680:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:1.0:1789575452.771698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575452.771838:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225024 00000100:00100000:3.0:1789575452.771854:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225024 00000100:00100000:3.0:1789575452.771946:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:3.0:1789575452.771958:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676225024:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575452.772259:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:5601:x1876505676225024:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 301us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.772269:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:2.0:1789575452.785391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575452.785736:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225152 00000100:00100000:3.0:1789575452.785747:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225152 00000100:00100000:3.0:1789575452.785809:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:3.0:1789575452.785817:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:6151:x1876505676225152:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789575452.786042:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:6151:x1876505676225152:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 226us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575452.786049:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:2.0:1789575452.798779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575452.798942:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225280 00000100:00100000:0.0:1789575452.798953:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225280 00000100:00100000:0.0:1789575452.799016:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:0.0:1789575452.799026:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:6151:x1876505676225280:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789575452.799708:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:6151:x1876505676225280:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 680us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575452.799717:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:1.0:1789575453.102946:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575453.102986:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699325440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575453.103100:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575453.103335:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325440 00000100:00100000:2.0:1789575453.103346:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325440 00000100:00100000:2.0:1789575453.103442:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789575453.103455:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699325440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575453.103503:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575453.103571:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699325440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575453.103579:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789575453.103651:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd59180 x1876505699325440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575453.103677:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699325440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575453.104339:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575453.679248:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575454.121351:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699325952:0@lo:400:kworker.0 00000100:00100000:2.0:1789575454.121506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575454.121581:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575454.121588:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699325568:0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122007:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699325696:0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575454.122078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699326208:0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575454.122125:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575454.122132:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699325824:0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575454.122197:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325952 00000100:00100000:0.0:1789575454.122206:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325952 00000100:00100000:0.0:1789575454.122253:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326208 00000100:00100000:0.0:1789575454.122257:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326208 00000100:00100000:0.0:1789575454.122297:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575454.122306:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699325952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122363:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699325952:12345-0@lo:400:kworker.0 Request processed in 58us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.122405:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575454.122423:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575454.122429:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699326208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122476:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699326208:12345-0@lo:400:kworker.0 Request processed in 36us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.122499:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575454.122520:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325696 00000100:00100000:0.0:1789575454.122524:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325696 00000100:00100000:0.0:1789575454.122548:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325824 00000100:00100000:0.0:1789575454.122550:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325824 00000100:00100000:0.0:1789575454.122569:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789575454.122575:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699325696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.122983:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699325696:12345-0@lo:400:kworker.0 Request processed in 408us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.122991:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789575454.123004:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789575454.123011:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699325824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.123040:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699325824:12345-0@lo:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.123045:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789575454.123073:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789575454.123077:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789575454.123116:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699325824:0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.123129:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699325696:0@lo:400:kworker.0 00010000:00080000:0.0:1789575454.123141:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58700 x1876505699326208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575454.123150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699326208:0@lo:400:kworker.0 00000100:00100000:2.0:1789575454.123334:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575454.123544:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699326080:0@lo:400:kworker.0 00000100:00100000:2.0:1789575454.123578:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575454.123731:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699325568 00000100:00100000:0.0:1789575454.123738:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699325568 00000100:00100000:0.0:1789575454.124970:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789575454.124999:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699325568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.125079:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699325568:12345-0@lo:400:kworker.0 Request processed in 85us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.125086:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789575454.125164:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326080 00000100:00100000:0.0:1789575454.125172:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326080 00000100:00100000:0.0:1789575454.125222:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789575454.125229:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699326080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575454.125265:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699326080:12345-0@lo:400:kworker.0 Request processed in 37us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.125271:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789575454.125301:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575454.126080:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699326080:0@lo:400:kworker.0 00010000:00080000:2.0:1789575454.126099:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5a300 x1876505699325952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575454.126110:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699325952:0@lo:400:kworker.0 00000100:00100000:2.0:1789575454.126135:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699325568:0@lo:400:kworker.0 00000100:00100000:1.0:1789575454.632967:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575454.632991:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575454.633077:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575454.633203:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326336 00000100:00100000:2.0:1789575454.633215:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326336 00000100:00100000:2.0:1789575454.633292:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789575454.633303:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699326336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575454.633346:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575454.633824:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699326336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 522us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575454.633830:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789575454.633916:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc39a300 x1876505699326336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575454.633936:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699326336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575454.697723:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575454.877859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575454.877913:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575454.878021:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575454.878060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575454.878097:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225792 00000100:00100000:3.0:1789575454.878109:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225792 00000100:00100000:3.0:1789575454.878183:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225664 00000100:00100000:3.0:1789575454.878187:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225664 00000100:00100000:3.0:1789575454.878211:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575454.878223:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676225792:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575454.878328:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676225792:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 105us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575454.878341:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575454.878360:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789575454.878424:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676225664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575454.878455:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676225664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575454.878461:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789575454.878657:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225408 00000100:00100000:0.0:1789575454.878663:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225408 00000100:00080000:2.0:1789575454.878697:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575454.878702:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789575454.878710:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:0.0:1789575454.878718:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676225408:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575454.878767:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676225408:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 51us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575454.878782:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:1.0:1789575454.879232:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225536 00000100:00100000:1.0:1789575454.879238:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225536 00000100:00100000:1.0:1789575454.879352:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:1.0:1789575454.879360:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676225536:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575454.879429:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676225536:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 70us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575454.879437:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00080000:2.0:1789575454.880366:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789575455.720738:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575456.744900:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575457.785352:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575458.217878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575458.217912:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575458.218006:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575458.218348:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326464 00000100:00100000:1.0:1789575458.218360:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326464 00000100:00100000:1.0:1789575458.218466:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789575458.218477:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699326464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575458.218521:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575458.218578:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699326464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575458.218585:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789575458.218634:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52680 x1876505699326464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575458.218654:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699326464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789575458.219211:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575458.792669:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575459.244022:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699326592:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244104:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244153:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699327104:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244180:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244206:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575459.244212:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699326976:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244246:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244276:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699326720:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244314:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699327232:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244348:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575459.244353:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699326848:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244389:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575459.244494:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326592 00000100:00100000:3.0:1789575459.244510:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326592 00000100:00100000:3.0:1789575459.244558:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789575459.244567:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699326592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.244614:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699326592:12345-0@lo:400:kworker.0 Request processed in 49us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.244621:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789575459.244652:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327104 00000100:00100000:3.0:1789575459.244656:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327104 00000100:00100000:3.0:1789575459.244690:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326720 00000100:00100000:3.0:1789575459.244693:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326720 00000100:00100000:3.0:1789575459.244706:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326848 00000100:00100000:3.0:1789575459.244709:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326848 00000100:00100000:3.0:1789575459.245853:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789575459.245864:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699327104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.245931:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699327104:12345-0@lo:400:kworker.0 Request processed in 69us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.245937:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789575459.245951:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789575459.245958:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.245993:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699326720:12345-0@lo:400:kworker.0 Request processed in 35us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.245998:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789575459.246009:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789575459.246015:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699326848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246043:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699326848:12345-0@lo:400:kworker.0 Request processed in 28us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.246048:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789575459.246082:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699326976 00000100:00100000:3.0:1789575459.246089:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699326976 00000100:00100000:3.0:1789575459.246117:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327232 00000100:00100000:3.0:1789575459.246120:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327232 00000100:00100000:3.0:1789575459.246136:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575459.246141:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246176:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699326976:12345-0@lo:400:kworker.0 Request processed in 35us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.246182:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575459.246193:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789575459.246200:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699327232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246240:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699327232:12345-0@lo:400:kworker.0 Request processed in 30us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.246246:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789575459.246537:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc399f80 x1876505699326976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575459.246554:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699326976:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246567:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699326592:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246579:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699327104:0@lo:400:kworker.0 00000100:00080000:3.0:1789575459.246610:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789575459.246615:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575459.246638:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699326848:0@lo:400:kworker.0 00000100:00100000:3.0:1789575459.246650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699326720:0@lo:400:kworker.0 00010000:00080000:3.0:1789575459.246663:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc399500 x1876505699327232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575459.246687:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699327232:0@lo:400:kworker.0 00000001:02000400:2.0:1789575459.536798:0:8828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789575459.753598:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575459.753676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575459.753787:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327360 00000100:00100000:1.0:1789575459.753805:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327360 00000100:00100000:1.0:1789575459.753862:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789575459.753871:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699327360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575459.753916:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575459.754023:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699327360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575459.754029:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789575459.758644:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52680 x1876505699327360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575459.758681:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699327360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789575459.822742:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575459.986735:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575459.986788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575459.988761:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676225920 00000100:00100000:3.0:1789575459.988776:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676225920 00000100:00100000:3.0:1789575459.988862:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:3.0:1789575459.988874:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676225920:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575459.988964:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676225920:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 91us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575459.988971:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:3.0:1789575459.991160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575459.991208:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575459.991295:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226176 00000100:00100000:1.0:1789575459.991307:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226176 00000100:00100000:1.0:1789575459.991399:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226304 00000100:00100000:1.0:1789575459.991402:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226304 00000100:00100000:1.0:1789575459.991425:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575459.991435:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2354:x1876505676226176:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789575459.991488:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22383104 00000100:00080000:1.0:1789575459.991502:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e9584720800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789575459.991563:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789575459.991940:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+2:2354:x1876505676226176:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 506us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575459.991950:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575459.991968:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789575459.991974:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2354:x1876505676226304:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789575459.991989:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a2238310b 00000100:00080000:1.0:1789575459.991995:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e96bd0cd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789575459.992014:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789575459.992198:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+2:2354:x1876505676226304:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 223us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575459.992205:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00010000:00010000:1.0:1789575459.993142:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789575459.993667:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789575459.993675:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575459.993691:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575459.998944:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226048 00000100:00100000:0.0:1789575459.998969:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226048 00000100:00100000:2.0:1789575459.999297:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789575459.999311:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676226048:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575459.999444:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676226048:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 135us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575459.999452:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00080000:3.0:1789575460.000211:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789575460.841550:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575461.870853:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789575461.913518:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:2.0:1789575461.913536:0:6734:0:(genops.c:885:class_export_put()) final put ffff8e9584725000/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:3.0:1789575461.913616:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584725000/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-OST0000 00000020:00000080:3.0:1789575461.913669:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9584720800 for lustre-OST0000 00010000:00010000:2.0:1789575462.888982:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575463.339083:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575463.339110:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699327488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575463.339187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575463.339274:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327488 00000100:00100000:3.0:1789575463.339282:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327488 00000100:00100000:3.0:1789575463.339340:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789575463.339350:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699327488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575463.339404:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575463.339906:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699327488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 555us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575463.339923:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789575463.339951:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789575463.339990:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc39ad80 x1876505699327488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575463.340013:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699327488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575463.914970:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575464.364563:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699328000:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.364642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.364703:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789575464.364710:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699327616:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.364739:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.364764:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699328128:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.365450:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.365486:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699327744:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.366424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.366459:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699328256:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.366488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.367033:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575464.367044:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699327872:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.367073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575464.367114:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328000 00000100:00100000:0.0:1789575464.367124:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328000 00000100:00100000:0.0:1789575464.367172:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328256 00000100:00100000:0.0:1789575464.367176:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328256 00000100:00100000:0.0:1789575464.367221:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789575464.367230:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699328000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.367286:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699328000:12345-0@lo:400:kworker.0 Request processed in 57us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575464.367294:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789575464.367311:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789575464.367318:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699328256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.367351:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699328256:12345-0@lo:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575464.367390:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789575464.367413:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327616 00000100:00100000:0.0:1789575464.367418:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327616 00000100:00100000:0.0:1789575464.367442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789575464.367449:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699327616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.367486:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699327616:12345-0@lo:400:kworker.0 Request processed in 37us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575464.367491:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789575464.367518:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328128 00000100:00100000:0.0:1789575464.367522:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328128 00000100:00100000:0.0:1789575464.367548:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327744 00000100:00100000:0.0:1789575464.367551:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327744 00000100:00100000:0.0:1789575464.367561:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699327872 00000100:00100000:0.0:1789575464.367563:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699327872 00000100:00100000:0.0:1789575464.367576:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789575464.367582:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699328128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.367613:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699328128:12345-0@lo:400:kworker.0 Request processed in 31us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575464.367619:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789575464.367631:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789575464.367637:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699327744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789575464.370964:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789575464.370977:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575464.371018:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789575464.371037:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699327872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575464.371126:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699327872:12345-0@lo:400:kworker.0 Request processed in 99us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575464.371133:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789575464.371933:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699327744:12345-0@lo:400:kworker.0 Request processed in 4292us (5508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575464.371944:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789575464.372000:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699327616:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.372019:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699328128:0@lo:400:kworker.0 00010000:00080000:0.0:1789575464.372049:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9687eab800 x1876505699328000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575464.372060:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699328000:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.372099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699327872:0@lo:400:kworker.0 00000100:00100000:0.0:1789575464.372113:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699327744:0@lo:400:kworker.0 00010000:00080000:0.0:1789575464.372126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876a8000 x1876505699328256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575464.372135:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699328256:0@lo:400:kworker.0 00000001:00100000:0.0:1789575464.406611:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:0.0:1789575464.406622:0:7664:0:(genops.c:885:class_export_put()) final put ffff8e96bd0cf800/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:3.0:1789575464.406699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd0cf800/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-OST0001 00000020:00000080:3.0:1789575464.406764:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bd0cd000 for lustre-OST0001 00000100:00100000:2.0:1789575464.874563:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575464.874588:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699328384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575464.874669:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575464.874750:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328384 00000100:00100000:2.0:1789575464.874759:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328384 00000100:00100000:2.0:1789575464.874811:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789575464.874820:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699328384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575464.874862:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575464.874912:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699328384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575464.874919:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789575464.874963:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5a680 x1876505699328384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575464.874995:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699328384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575464.936515:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575465.102628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575465.102675:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575465.102684:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226432 00000100:00100000:1.0:1789575465.102697:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226432 00000100:00100000:3.0:1789575465.102702:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226560 00000100:00100000:3.0:1789575465.102704:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226560 00000100:00100000:1.0:1789575465.102751:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:3.0:1789575465.102752:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:3.0:1789575465.102761:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676226560:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575465.102761:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676226432:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575465.102926:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676226432:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 165us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575465.102934:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:3.0:1789575465.108972:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676226560:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 6194us (6278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575465.108991:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00080000:3.0:1789575465.109045:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789575465.633064:0:9075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing yml_node 00010000:00010000:0.0:1789575465.970502:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575466.984680:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575468.009431:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575468.460366:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699328512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575468.460510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575468.460858:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328512 00000100:00100000:2.0:1789575468.460870:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328512 00000100:00100000:2.0:1789575468.460956:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789575468.460966:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699328512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575468.461004:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575468.461058:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699328512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575468.461065:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789575468.461105:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc399880 x1876505699328512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575468.461126:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699328512:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789575468.461355:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789575469.033662:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575469.481126:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699328768:0@lo:400:kworker.0 00000100:00100000:2.0:1789575469.481215:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575469.481268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699329280:0@lo:400:kworker.0 00000100:00100000:2.0:1789575469.481293:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575469.481325:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575469.481331:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699328896:0@lo:400:kworker.0 00000100:00100000:2.0:1789575469.481352:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575469.481797:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328768 00000100:00100000:0.0:1789575469.481815:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328768 00000100:00100000:0.0:1789575469.481870:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328896 00000100:00100000:0.0:1789575469.481873:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328896 00000100:00100000:0.0:1789575469.481905:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789575469.481916:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699328768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575469.487973:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789575469.488005:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699328896:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789575469.490605:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575469.490648:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699328640:0@lo:400:kworker.0 00000100:00100000:3.0:1789575469.490748:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575469.490804:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699329152:0@lo:400:kworker.0 00000100:00100000:3.0:1789575469.490832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575469.490859:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575469.490879:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699329024:0@lo:400:kworker.0 00000100:00100000:3.0:1789575469.490912:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575469.490946:0:5862:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789575469.490956:0:5862:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789575469.490975:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329280 00000100:00100000:3.0:1789575469.490986:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329280 00000100:00100000:3.0:1789575469.491441:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329024 00000100:00100000:3.0:1789575469.491447:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329024 00000100:00100000:3.0:1789575469.491621:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789575469.491633:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699329280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575469.498025:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699328768:12345-0@lo:400:kworker.0 Request processed in 16096us (16794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575469.498048:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789575469.499790:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699328896:12345-0@lo:400:kworker.0 Request processed in 11787us (18424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575469.499808:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789575469.499851:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329152 00000100:00100000:1.0:1789575469.499974:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329152 00000100:00100000:1.0:1789575469.500055:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789575469.500065:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699329152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575469.500177:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699329152:12345-0@lo:400:kworker.0 Request processed in 113us (9342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575469.500183:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789575469.500245:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699329152:0@lo:400:kworker.0 00000100:00100000:1.0:1789575469.500461:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699328640 00000100:00100000:1.0:1789575469.500467:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699328640 00000100:00100000:1.0:1789575469.500499:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789575469.500525:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575469.500568:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699328640:12345-0@lo:400:kworker.0 Request processed in 45us (9819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575469.500574:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789575469.500614:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699328640:0@lo:400:kworker.0 00000100:00100000:1.0:1789575469.500659:0:6708:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789575469.500668:0:6708:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1789575469.502462:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575469.502473:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575469.502805:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789575469.502852:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699329024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575469.502987:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699329024:12345-0@lo:400:kworker.0 Request processed in 170us (12072us total) trans 0 rc 0/0 00010000:00080000:1.0:1789575469.504217:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5bb80 x1876505699329024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575469.504238:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699329024:0@lo:400:kworker.0 00000100:00100000:0.0:1789575469.504344:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789575469.504892:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699329280:12345-0@lo:400:kworker.0 Request processed in 13257us (23593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575469.504903:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789575469.510011:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699328896:0@lo:400:kworker.0 00000100:00100000:2.0:1789575469.510033:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699328768:0@lo:400:kworker.0 00010000:00080000:2.0:1789575469.510048:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f9180 x1876505699329280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575469.510081:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699329280:0@lo:400:kworker.0 00000100:00100000:3.0:1789575469.993477:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575469.993501:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699329408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575469.993616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575469.993774:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329408 00000100:00100000:0.0:1789575469.993787:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329408 00000100:00100000:0.0:1789575469.993858:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789575469.993870:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699329408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575469.993917:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575469.993984:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699329408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575469.993991:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789575469.994254:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52300 x1876505699329408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575469.994276:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699329408:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575470.057310:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575470.241235:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575470.241288:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575470.241420:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226816 00000100:00100000:3.0:1789575470.241431:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226816 00000100:00100000:3.0:1789575470.241509:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:3.0:1789575470.241520:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676226816:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575470.241622:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676226816:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575470.241630:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:1.0:1789575470.242051:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226688 00000100:00100000:1.0:1789575470.242057:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226688 00000100:00100000:1.0:1789575470.242104:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:1.0:1789575470.242112:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676226688:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575470.242163:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676226688:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 51us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575470.242170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00080000:2.0:1789575470.242639:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789575471.080645:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789575471.836137:0:9270:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789575472.105624:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575473.138519:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575473.576861:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699329536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575473.576954:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575473.577243:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329536 00000100:00100000:2.0:1789575473.577252:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329536 00000100:00100000:2.0:1789575473.577342:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789575473.577353:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699329536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575473.577427:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575473.577482:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699329536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575473.577490:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789575473.577536:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc944000 x1876505699329536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575473.577557:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699329536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575473.577959:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575474.152640:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575474.605887:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699329664:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.606032:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.606135:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699330176:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.606172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.608072:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575474.608129:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699330048:0@lo:400:kworker.0 00000100:00100000:3.0:1789575474.609330:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330176 00000100:00100000:3.0:1789575474.609353:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330176 00000100:00100000:3.0:1789575474.609505:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789575474.609526:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699330176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575474.609667:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699330176:12345-0@lo:400:kworker.0 Request processed in 152us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575474.609676:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789575474.610311:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.610432:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699330176:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610484:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699329792:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610528:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.610550:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699330304:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.610622:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575474.610629:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699329920:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575474.610691:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330048 00000100:00100000:0.0:1789575474.610699:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330048 00000100:00100000:0.0:1789575474.610746:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330304 00000100:00100000:0.0:1789575474.610749:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330304 00000100:00100000:0.0:1789575474.610781:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789575474.610789:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699330048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610843:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699330048:12345-0@lo:400:kworker.0 Request processed in 55us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575474.610851:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789575474.610869:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789575474.610875:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699330304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.610905:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699330304:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575474.610910:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789575474.610931:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329792 00000100:00100000:0.0:1789575474.610936:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329792 00000100:00100000:0.0:1789575474.610959:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329920 00000100:00100000:0.0:1789575474.610962:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329920 00000100:00100000:0.0:1789575474.610982:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789575474.610988:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699329792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.611019:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699329792:12345-0@lo:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575474.611025:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789575474.611036:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789575474.611041:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699329920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.611074:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699329920:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575474.611079:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789575474.611133:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699329920:0@lo:400:kworker.0 00000100:00100000:0.0:1789575474.611144:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699329792:0@lo:400:kworker.0 00010000:00080000:0.0:1789575474.611157:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876a9880 x1876505699330304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575474.611168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699330304:0@lo:400:kworker.0 00010000:00080000:0.0:1789575474.611215:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876a8700 x1876505699330048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575474.611225:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699330048:0@lo:400:kworker.0 00000100:00100000:1.0:1789575474.612781:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699329664 00000100:00100000:1.0:1789575474.612802:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699329664 00000100:00100000:1.0:1789575474.612874:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789575474.612884:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575474.612993:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699329664:12345-0@lo:400:kworker.0 Request processed in 109us (6960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575474.613000:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789575474.613028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699329664:0@lo:400:kworker.0 00000100:00080000:1.0:1789575474.613050:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575474.613059:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789575474.950040:0:9368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:1.0:1789575475.114545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575475.114808:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699330432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575475.114929:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575475.115079:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330432 00000100:00100000:3.0:1789575475.115103:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330432 00000100:00100000:3.0:1789575475.115201:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789575475.115213:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699330432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575475.115263:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575475.115333:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699330432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575475.115342:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789575475.115451:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52d80 x1876505699330432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575475.115481:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699330432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575475.182944:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575475.339536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575475.339605:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575475.339652:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227072 00000100:00100000:3.0:1789575475.339670:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227072 00000100:00100000:3.0:1789575475.339775:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:3.0:1789575475.339789:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676227072:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575475.339918:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676227072:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 132us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575475.339927:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789575475.340416:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676226944 00000100:00100000:1.0:1789575475.340423:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676226944 00000100:00100000:1.0:1789575475.340474:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:1.0:1789575475.340483:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676226944:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575475.340524:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676226944:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 43us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575475.340531:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00080000:1.0:1789575475.340564:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789575476.209880:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575477.229356:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789575478.158009:0:9466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1789575478.248964:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575478.702018:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575478.702073:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699330560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575478.702206:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575478.702888:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330560 00000100:00100000:3.0:1789575478.702906:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330560 00000100:00100000:3.0:1789575478.703075:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789575478.703090:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699330560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575478.703158:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575478.703252:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699330560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575478.703261:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789575478.703954:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc944a80 x1876505699330560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575478.703988:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699330560:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575478.708258:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575479.273874:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575479.727771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699330688:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.727872:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728196:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699331200:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728267:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789575479.728273:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699331072:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728298:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699330944:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728353:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789575479.728409:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699330816:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728431:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728448:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699331328:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575479.728491:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330688 00000100:00100000:2.0:1789575479.728499:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330688 00000100:00100000:2.0:1789575479.728539:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789575479.728547:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699330688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728602:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699330688:12345-0@lo:400:kworker.0 Request processed in 55us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575479.728609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789575479.728643:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331200 00000100:00100000:2.0:1789575479.728647:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331200 00000100:00100000:2.0:1789575479.728681:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330944 00000100:00100000:2.0:1789575479.728685:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330944 00000100:00100000:2.0:1789575479.728707:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699330816 00000100:00100000:2.0:1789575479.728709:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699330816 00000100:00100000:2.0:1789575479.728723:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789575479.728728:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699331200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728758:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699331200:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575479.728764:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789575479.728785:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789575479.728790:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699330944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728820:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699330944:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575479.728826:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789575479.728835:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789575479.728841:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699330816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.728865:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699330816:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575479.728870:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789575479.732784:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331328 00000100:00100000:3.0:1789575479.732803:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331328 00000100:00100000:3.0:1789575479.732866:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789575479.732876:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699331328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.734407:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331072 00000100:00100000:2.0:1789575479.734422:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331072 00000100:00100000:2.0:1789575479.734476:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699330688:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.734493:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699331200:0@lo:400:kworker.0 00000100:00080000:2.0:1789575479.734521:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789575479.734527:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575479.734548:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699330816:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.734561:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699330944:0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.734633:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789575479.734642:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699331072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575479.734750:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699331072:12345-0@lo:400:kworker.0 Request processed in 108us (6448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575479.734757:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789575479.734788:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f8e00 x1876505699331072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575479.734812:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699331072:0@lo:400:kworker.0 00000100:00100000:3.0:1789575479.735296:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699331328:12345-0@lo:400:kworker.0 Request processed in 2420us (6828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575479.735305:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789575479.735362:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913fad80 x1876505699331328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575479.735395:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699331328:0@lo:400:kworker.0 00000001:02000400:0.0:1789575479.993899:0:9514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 12:17:58 EDT 2026 00000100:00100000:3.0:1789575480.232753:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575480.232856:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575480.233129:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331456 00000100:00100000:1.0:1789575480.233139:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331456 00000100:00100000:1.0:1789575480.233210:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789575480.233220:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699331456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575480.233261:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575480.233319:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699331456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575480.233326:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789575480.233510:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52a00 x1876505699331456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575480.233531:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699331456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789575480.297107:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575480.461023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575480.461092:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575480.461215:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227200 00000100:00100000:1.0:1789575480.461225:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227200 00000100:00100000:1.0:1789575480.461304:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:1.0:1789575480.461317:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676227200:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575480.461470:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676227200:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 157us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575480.461478:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:2.0:1789575480.465758:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227328 00000100:00100000:2.0:1789575480.465795:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227328 00000100:00100000:2.0:1789575480.465956:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:2.0:1789575480.465970:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676227328:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575480.466127:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676227328:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 160us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575480.466136:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00080000:1.0:1789575480.466937:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789575481.322212:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575482.349441:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575483.370048:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575483.818450:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575483.819409:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699331584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575483.820089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575483.820479:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331584 00000100:00100000:2.0:1789575483.820496:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331584 00000100:00100000:2.0:1789575483.820603:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789575483.820978:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575483.821034:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699331584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575483.821124:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575483.821221:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699331584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 606us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575483.821230:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789575483.821348:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc946d80 x1876505699331584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575483.821411:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699331584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575484.392655:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575484.841194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699332096:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.841303:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.842794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575484.842820:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699331712:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.842898:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.842939:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699332224:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.842972:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.843060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699331840:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843094:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.843115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699332352:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.843196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575484.843205:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699331968:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575484.843275:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332096 00000100:00100000:2.0:1789575484.843289:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332096 00000100:00100000:2.0:1789575484.843353:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332352 00000100:00100000:2.0:1789575484.843356:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332352 00000100:00100000:2.0:1789575484.843415:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789575484.843426:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699332096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843507:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699332096:12345-0@lo:400:kworker.0 Request processed in 82us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575484.843516:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789575484.843539:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789575484.843546:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699332352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843579:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699332352:12345-0@lo:400:kworker.0 Request processed in 34us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575484.843585:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789575484.843623:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332224 00000100:00100000:2.0:1789575484.843628:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332224 00000100:00100000:2.0:1789575484.843659:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331840 00000100:00100000:2.0:1789575484.843662:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331840 00000100:00100000:2.0:1789575484.843679:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331968 00000100:00100000:2.0:1789575484.843682:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331968 00000100:00100000:2.0:1789575484.843698:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789575484.843719:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699332224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843760:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699332224:12345-0@lo:400:kworker.0 Request processed in 44us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575484.843767:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789575484.843779:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789575484.843784:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699331840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843810:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699331840:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575484.843817:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789575484.843827:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789575484.843834:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699331968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843861:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699331968:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575484.843868:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789575484.843919:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699331968:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.843932:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699331840:0@lo:400:kworker.0 00010000:00080000:2.0:1789575484.843945:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f9880 x1876505699332352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575484.843958:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699332352:0@lo:400:kworker.0 00000100:00100000:2.0:1789575484.844012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699332224:0@lo:400:kworker.0 00010000:00080000:2.0:1789575484.844025:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f9f80 x1876505699332096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575484.844035:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699332096:0@lo:400:kworker.0 00000100:00100000:3.0:1789575484.847036:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699331712 00000100:00100000:3.0:1789575484.847083:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699331712 00000100:00100000:3.0:1789575484.847188:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789575484.847202:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699331712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575484.847626:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699331712:12345-0@lo:400:kworker.0 Request processed in 425us (4725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575484.847636:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1789575484.847726:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789575484.847735:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575484.849837:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699331712:0@lo:400:kworker.0 00000100:00100000:3.0:1789575485.354574:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699332480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575485.354692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575485.354880:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332480 00000100:00100000:0.0:1789575485.354895:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332480 00000100:00100000:0.0:1789575485.354980:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789575485.355003:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699332480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575485.355070:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575485.355156:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699332480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575485.355176:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789575485.355280:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd52a00 x1876505699332480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575485.355535:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699332480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789575485.417593:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575485.582443:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575485.582523:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575485.582881:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227456 00000100:00100000:0.0:1789575485.582901:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227456 00000100:00100000:0.0:1789575485.582997:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 208 00000100:00100000:0.0:1789575485.583012:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2358:x1876505676227456:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575485.583894:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2358:x1876505676227456:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 881us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575485.583906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 208 00000100:00100000:1.0:1789575485.585172:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227584 00000100:00100000:1.0:1789575485.585192:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227584 00000100:00080000:3.0:1789575485.585271:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575485.585298:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:1.0:1789575485.585311:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676227584:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575485.585422:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676227584:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 113us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575485.585431:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00010000:00010000:3.0:1789575486.441738:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575487.464699:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575488.489776:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575488.936889:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699332608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575488.937017:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575488.937229:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332608 00000100:00100000:3.0:1789575488.937241:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332608 00000100:00080000:2.0:1789575488.937393:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575488.938521:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789575488.938544:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699332608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575488.938591:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575488.938684:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699332608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575488.938691:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789575488.938808:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc946680 x1876505699332608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575488.938834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc946680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699332608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575489.513078:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575489.960718:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699333120:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.960823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.960889:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575489.960895:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699332736:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.960928:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.960964:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699333248:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.960993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.961027:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699332864:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.961051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.961069:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699333376:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.961091:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.961110:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575489.961115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699332992:0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.961134:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575489.961163:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333120 00000100:00100000:2.0:1789575489.961172:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333120 00000100:00100000:2.0:1789575489.961227:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333376 00000100:00100000:2.0:1789575489.961231:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333376 00000100:00100000:2.0:1789575489.961259:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789575489.961268:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699333120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.961326:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699333120:12345-0@lo:400:kworker.0 Request processed in 59us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575489.961333:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789575489.961351:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789575489.961357:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699333376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575489.961419:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699333376:12345-0@lo:400:kworker.0 Request processed in 62us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575489.961437:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789575489.961454:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789575489.961489:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd8f480 x1876505699333376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575489.961505:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699333376:0@lo:400:kworker.0 00010000:00080000:2.0:1789575489.961546:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd8d180 x1876505699333120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575489.961555:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699333120:0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.963911:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332736 00000100:00100000:3.0:1789575489.963929:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332736 00000100:00100000:3.0:1789575489.964011:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789575489.964023:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964134:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699332736:12345-0@lo:400:kworker.0 Request processed in 114us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575489.964141:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789575489.964176:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333248 00000100:00100000:3.0:1789575489.964180:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333248 00000100:00100000:3.0:1789575489.964212:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332864 00000100:00100000:3.0:1789575489.964215:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332864 00000100:00100000:3.0:1789575489.964245:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699332992 00000100:00100000:3.0:1789575489.964248:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699332992 00000100:00100000:3.0:1789575489.964280:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789575489.964287:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964322:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699333248:12345-0@lo:400:kworker.0 Request processed in 36us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575489.964329:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789575489.964342:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575489.964347:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699332864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964412:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699332864:12345-0@lo:400:kworker.0 Request processed in 64us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575489.964418:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575489.964440:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789575489.964446:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699332992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964476:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699332992:12345-0@lo:400:kworker.0 Request processed in 30us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575489.964482:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789575489.964783:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575489.964828:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699332992:0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964845:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699332864:0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964902:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699332736:0@lo:400:kworker.0 00000100:00100000:3.0:1789575489.964915:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699333248:0@lo:400:kworker.0 00000100:00100000:3.0:1789575490.472574:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575490.472607:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699333504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575490.472693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575490.472759:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333504 00000100:00100000:3.0:1789575490.472767:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333504 00000100:00100000:3.0:1789575490.472814:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789575490.472957:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699333504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575490.472992:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575490.473040:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699333504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575490.473047:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789575490.473092:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc944700 x1876505699333504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575490.473110:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699333504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575490.536851:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575490.704115:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575490.704168:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575490.704242:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227712 00000100:00100000:1.0:1789575490.704258:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227712 00000100:00100000:1.0:1789575490.704323:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:1.0:1789575490.704334:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2355:x1876505676227712:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575490.704441:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:2355:x1876505676227712:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575490.704448:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:3.0:1789575490.705064:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227840 00000100:00100000:3.0:1789575490.705071:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227840 00000100:00100000:3.0:1789575490.705142:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:3.0:1789575490.705150:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2355:x1876505676227840:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575490.705200:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2355:x1876505676227840:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 51us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575490.705208:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00080000:2.0:1789575490.705262:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789575491.561577:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575492.591408:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575493.609496:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575494.060823:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575494.060848:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699333632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575494.060938:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575494.061481:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333632 00000100:00100000:3.0:1789575494.061492:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333632 00000100:00100000:3.0:1789575494.061571:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789575494.061580:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699333632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575494.061793:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789575494.061845:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575494.061932:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699333632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 353us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575494.061941:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789575494.062035:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc944700 x1876505699333632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575494.062057:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699333632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575494.634065:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575495.083262:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699333760:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.083335:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084003:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699334272:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084044:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084077:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575495.084084:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699334144:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699333888:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084236:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699334400:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084256:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575495.084292:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699334016:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575495.084358:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333760 00000100:00100000:0.0:1789575495.084367:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333760 00000100:00100000:0.0:1789575495.084617:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789575495.084626:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699333760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084684:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699333760:12345-0@lo:400:kworker.0 Request processed in 59us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.084691:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789575495.084726:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334272 00000100:00100000:0.0:1789575495.084730:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334272 00000100:00100000:0.0:1789575495.084883:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699333888 00000100:00100000:0.0:1789575495.084887:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699333888 00000100:00100000:0.0:1789575495.084919:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334016 00000100:00100000:0.0:1789575495.084922:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334016 00000100:00100000:0.0:1789575495.084941:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789575495.084947:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699334272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.084981:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699334272:12345-0@lo:400:kworker.0 Request processed in 34us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.084986:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789575495.084998:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789575495.085004:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699333888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.085035:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699333888:12345-0@lo:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.085041:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789575495.085052:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789575495.085058:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699334016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.085096:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699334016:12345-0@lo:400:kworker.0 Request processed in 38us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.085102:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789575495.085121:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334144 00000100:00100000:0.0:1789575495.085124:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334144 00000100:00100000:0.0:1789575495.085158:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334400 00000100:00100000:0.0:1789575495.085162:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334400 00000100:00100000:0.0:1789575495.085184:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789575495.085191:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699334144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.085504:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699334144:12345-0@lo:400:kworker.0 Request processed in 313us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.085512:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789575495.085525:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789575495.085531:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699334400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.085559:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699334400:12345-0@lo:400:kworker.0 Request processed in 29us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.085565:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789575495.085589:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575495.085593:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575495.087715:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699334016:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.087733:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699333888:0@lo:400:kworker.0 00010000:00080000:0.0:1789575495.087747:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876aa300 x1876505699334400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575495.087895:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699334400:0@lo:400:kworker.0 00010000:00080000:0.0:1789575495.087953:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876ab480 x1876505699334144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575495.087971:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699334144:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.087987:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699333760:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.088000:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699334272:0@lo:400:kworker.0 00000100:00100000:0.0:1789575495.593813:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699334528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575495.593886:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575495.594228:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334528 00000100:00100000:3.0:1789575495.594238:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334528 00000100:00100000:3.0:1789575495.594333:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789575495.594344:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699334528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575495.594408:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575495.594457:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699334528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575495.594464:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789575495.594535:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc945880 x1876505699334528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575495.594554:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699334528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575495.656552:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575495.823161:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575495.823218:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575495.823357:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676227968 00000100:00100000:3.0:1789575495.823404:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676227968 00000100:00100000:3.0:1789575495.823470:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:3.0:1789575495.823480:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676227968:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575495.823552:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676227968:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 73us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575495.823559:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:0.0:1789575495.823916:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228096 00000100:00100000:0.0:1789575495.823922:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228096 00000100:00100000:0.0:1789575495.823983:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:0.0:1789575495.823990:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676228096:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575495.824032:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676228096:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 43us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575495.824039:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00080000:1.0:1789575495.824142:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789575496.680879:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575497.704601:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789575498.066811:0:10144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:18:16 (1789575496) === 00000100:00100000:2.0:1789575498.569250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.569477:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228224 00000100:00100000:1.0:1789575498.569492:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228224 00000100:00100000:1.0:1789575498.569562:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:1.0:1789575498.569575:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+10:8146:x1876505676228224:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789575498.569600:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575498.569626:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1c00/0xc45cc82a223831cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae593d expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575498.569664:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1c00/0xc45cc82a223831cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae593d expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575498.569675:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1c00/0xc45cc82a223831cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae593d expref: 11 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575498.569684:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1c00, rc 0) 00000100:00100000:1.0:1789575498.569750:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228224:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 178us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.569778:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:1.0:1789575498.572771:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.573115:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228352 00000100:00100000:0.0:1789575498.573132:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228352 00000100:00100000:0.0:1789575498.573324:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00100000:0.0:1789575498.573339:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228352:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789575498.573844:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228352:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 508us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575498.573854:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00100000:2.0:1789575498.576642:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.580860:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228480 00000100:00100000:1.0:1789575498.580896:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228480 00000100:00100000:1.0:1789575498.581075:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:1.0:1789575498.581088:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228480:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789575498.582739:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228480:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 1637us (6095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.582758:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:2.0:1789575498.593433:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.593807:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228608 00000100:00100000:0.0:1789575498.593820:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228608 00000100:00100000:0.0:1789575498.593902:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:0.0:1789575498.593915:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:8150:x1876505676228608:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789575498.594821:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:8150:x1876505676228608:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 901us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575498.594835:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:2.0:1789575498.623420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.623693:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228736 00000100:00100000:1.0:1789575498.623709:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228736 00000100:00100000:1.0:1789575498.623799:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:1.0:1789575498.623813:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:8150:x1876505676228736:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789575498.624315:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:8150:x1876505676228736:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 500us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.624326:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:2.0:1789575498.630013:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.630340:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228864 00000100:00100000:0.0:1789575498.630355:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228864 00000100:00100000:0.0:1789575498.630501:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:0.0:1789575498.630514:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:8146:x1876505676228864:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789575498.630537:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575498.630562:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680030200/0xc45cc82a223831d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5967 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.630599:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030200/0xc45cc82a223831d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5967 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.630612:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680030200/0xc45cc82a223831d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5967 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.630623:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030200, rc 0) 00000100:00100000:0.0:1789575498.630702:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:8146:x1876505676228864:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 190us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575498.630709:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:2.0:1789575498.637988:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.638130:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676228992 00000100:00100000:1.0:1789575498.638146:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676228992 00000100:00100000:1.0:1789575498.638227:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:1.0:1789575498.638241:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:8146:x1876505676228992:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789575498.638278:0:5857:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789575498.638316:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789575498.638322:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789575498.638326:0:5857:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789575498.638329:0:5857:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789575498.642566:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:8146:x1876505676228992:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 3832us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.642586:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:2.0:1789575498.651554:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.651787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229120 00000100:00100000:0.0:1789575498.651802:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229120 00000100:00100000:0.0:1789575498.651896:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:0.0:1789575498.651911:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:8146:x1876505676229120:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789575498.651936:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575498.651983:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae596e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.652027:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.652042:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575498.652055:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031600, rc 0) 00000100:00100000:0.0:1789575498.652301:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:8146:x1876505676229120:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 392us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575498.652309:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:2.0:1789575498.659784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.659945:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229248 00000100:00100000:1.0:1789575498.659962:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229248 00000100:00100000:1.0:1789575498.660537:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:1.0:1789575498.660552:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:8146:x1876505676229248:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789575498.661066:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:8146:x1876505676229248:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 515us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.661089:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:2.0:1789575498.665909:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575498.666016:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229376 00000100:00100000:3.0:1789575498.666029:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229376 00000100:00100000:3.0:1789575498.666099:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:3.0:1789575498.666110:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:8146:x1876505676229376:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789575498.666766:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:8146:x1876505676229376:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 656us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575498.666784:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:2.0:1789575498.670855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.674596:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229504 00000100:00100000:1.0:1789575498.674618:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229504 00000100:00100000:1.0:1789575498.674746:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:1.0:1789575498.674758:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:8153:x1876505676229504:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789575498.676542:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:8153:x1876505676229504:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 1769us (5684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.676559:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:2.0:1789575498.686451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575498.689552:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229632 00000100:00100000:3.0:1789575498.689580:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229632 00000100:00100000:3.0:1789575498.689682:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:3.0:1789575498.689694:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:8153:x1876505676229632:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789575498.690052:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:8153:x1876505676229632:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 358us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575498.690061:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:2.0:1789575498.706041:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575498.706155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.718402:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229760 00000100:00100000:0.0:1789575498.718427:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229760 00000100:00100000:0.0:1789575498.719518:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230144 00000100:00100000:0.0:1789575498.719532:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230144 00000100:00080000:2.0:1789575498.719624:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575498.722601:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:1.0:1789575498.722640:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676230144:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575498.722797:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676230144:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 178us (16640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.722806:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:1.0:1789575498.722852:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575498.722859:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1876505676229760:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789575498.722904:0:5864:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1@192.168.202.32@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1789575498.722977:0:5864:0:(genops.c:1384:class_connect()) connect: client b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1, cookie 0xc45cc82a223831e4 00000004:00100000:1.0:1789575498.723022:0:5864:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789575498.724681:0:5864:0:(import.c:65:import_set_state_nolock()) ffff8e9690b9b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575498.724792:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2354:x1876505676229760:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 1927us (18762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.724804:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00010000:00010000:2.0:1789575498.728930:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575498.731025:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575498.731082:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575498.731197:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230016 00000100:00100000:3.0:1789575498.731202:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676229888 00000100:00100000:3.0:1789575498.731214:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676229888 00000100:00100000:0.0:1789575498.731214:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230016 00000100:00100000:3.0:1789575498.731328:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789575498.731529:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+7:0:x1876505676229888:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789575498.731599:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789575498.734280:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575498.735504:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+7:0:x1876505676229888:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 4154us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575498.738104:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789575498.738987:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:1.0:1789575498.739019:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230016:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789575498.739069:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789575498.739309:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230016:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 307us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.739318:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575498.754302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.759080:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230272 00000100:00100000:1.0:1789575498.759109:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230272 00000100:00100000:1.0:1789575498.759321:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789575498.759336:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230272:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789575498.761819:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230272:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 2459us (7507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.761841:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575498.772585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575498.772650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575498.772804:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230400 00000100:00100000:3.0:1789575498.772819:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230400 00000100:00100000:3.0:1789575498.772906:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230528 00000100:00100000:3.0:1789575498.772910:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230528 00000100:00100000:3.0:1789575498.772942:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789575498.772953:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876505676230400:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789575498.773001:0:6708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1@192.168.202.32@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1789575498.773046:0:6708:0:(genops.c:1384:class_connect()) connect: client b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1, cookie 0xc45cc82a223831eb 00002000:00100000:3.0:1789575498.773064:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1/ffff8e96bc894000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575498.773097:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575498.773471:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789575498.773649:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96bc891800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575498.773740:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2354:x1876505676230400:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 787us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575498.773749:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789575498.773773:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575498.773778:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876505676230528:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789575498.773796:0:6708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1@192.168.202.32@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1789575498.773815:0:6708:0:(genops.c:1384:class_connect()) connect: client b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1, cookie 0xc45cc82a223831f2 00002000:00100000:3.0:1789575498.773821:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1/ffff8e96bc895000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575498.773846:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575498.774004:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789575498.774021:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96bc890000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575498.774047:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2354:x1876505676230528:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 268us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575498.774055:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575498.774978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575498.775092:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230656 00000100:00100000:1.0:1789575498.775104:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230656 00000100:00100000:1.0:1789575498.775506:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789575498.775521:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230656:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789575498.775630:0:5865:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789575498.775734:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:8146:x1876505676230656:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 218us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575498.775761:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789575499.177103:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575499.177150:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699334656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575499.177260:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575499.178446:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334656 00000100:00100000:3.0:1789575499.178462:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334656 00000100:00100000:3.0:1789575499.179560:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789575499.179576:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699334656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575499.179611:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575499.179713:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699334656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575499.179720:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789575499.181872:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc945c00 x1876505699334656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575499.181960:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699334656:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575499.186725:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575499.752508:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575500.203411:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699334784:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.203524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.203600:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699335296:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.203636:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.203674:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575500.203680:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699335168:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.203707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.203742:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699334912:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.203767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.203796:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699335424:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.203822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.204538:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575500.204559:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699335040:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.204615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.204692:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334784 00000100:00100000:0.0:1789575500.204705:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334784 00000100:00100000:0.0:1789575500.204779:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789575500.204790:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699334784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.204921:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699334784:12345-0@lo:400:kworker.0 Request processed in 131us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.204929:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789575500.204985:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335296 00000100:00100000:0.0:1789575500.204990:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335296 00000100:00100000:0.0:1789575500.205038:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699334912 00000100:00100000:0.0:1789575500.205042:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699334912 00000100:00100000:0.0:1789575500.205062:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335040 00000100:00100000:0.0:1789575500.205064:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335040 00000100:00100000:0.0:1789575500.205079:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789575500.205085:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699335296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.205122:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699335296:12345-0@lo:400:kworker.0 Request processed in 37us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.205129:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789575500.205142:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789575500.205148:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699334912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.205183:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699334912:12345-0@lo:400:kworker.0 Request processed in 34us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.205200:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789575500.205212:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789575500.205218:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699335040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.205251:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699335040:12345-0@lo:400:kworker.0 Request processed in 34us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.205256:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789575500.205389:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335168 00000100:00100000:0.0:1789575500.205394:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335168 00000100:00100000:0.0:1789575500.205504:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335424 00000100:00100000:0.0:1789575500.205509:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335424 00000100:00100000:0.0:1789575500.205539:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789575500.205547:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699335168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.205589:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699335168:12345-0@lo:400:kworker.0 Request processed in 43us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.205594:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789575500.205606:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789575500.205612:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.205647:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc07f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699335424:12345-0@lo:400:kworker.0 Request processed in 35us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.205653:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789575500.205923:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575500.205930:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575500.205987:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699335040:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.206004:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699334912:0@lo:400:kworker.0 00010000:00080000:0.0:1789575500.206025:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d9880 x1876505699335424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575500.206048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699335424:0@lo:400:kworker.0 00010000:00080000:0.0:1789575500.206110:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e95876a8380 x1876505699335168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575500.206120:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699335168:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.206131:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699334784:0@lo:400:kworker.0 00000100:00100000:0.0:1789575500.206144:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699335296:0@lo:400:kworker.0 00000001:00100000:2.0:1789575500.294205:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000001:00100000:0.0:1789575500.311893:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000100:00100000:0.0:1789575500.723042:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699335552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575500.723148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575500.723257:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335552 00000100:00100000:0.0:1789575500.723270:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335552 00000100:00100000:0.0:1789575500.723340:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789575500.723351:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699335552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575500.723427:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575500.723483:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699335552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575500.723491:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789575500.723545:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d9880 x1876505699335552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575500.723568:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699335552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575500.779086:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575501.819896:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575502.831140:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789575502.833212:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00010000:00010000:3.0:1789575503.849046:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575504.033771:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575504.033849:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575504.033878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575504.033898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575504.033920:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575504.033964:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231296 00000100:00100000:2.0:1789575504.033975:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231296 00000100:00100000:3.0:1789575504.034023:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230784 00000100:00100000:3.0:1789575504.034029:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230784 00000100:00100000:2.0:1789575504.034060:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231168 00000100:00080000:1.0:1789575504.034060:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575504.034065:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231168 00000100:00100000:3.0:1789575504.034088:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00080000:1.0:1789575504.034096:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575504.034115:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676230784:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575504.034118:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789575504.034142:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231296:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575504.034156:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:1.0:1789575504.034181:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231168:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575504.034256:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231296:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575504.034267:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231168:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575504.034278:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789575504.034300:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789575504.035574:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231040 00000100:00100000:0.0:1789575504.035612:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231040 00000100:00100000:0.0:1789575504.035755:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676230912 00000100:00100000:0.0:1789575504.035764:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676230912 00000100:00100000:0.0:1789575504.035827:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:0.0:1789575504.035843:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231040:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575504.035946:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231040:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 109us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575504.035953:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:0.0:1789575504.035972:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:0.0:1789575504.035978:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676230912:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575504.036006:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676230912:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575504.036014:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00080000:0.0:1789575504.036053:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575504.037676:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676230784:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 3558us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575504.037690:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00100000:1.0:1789575504.301647:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575504.301672:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699335680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575504.301742:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575504.302230:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335680 00000100:00100000:3.0:1789575504.302240:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335680 00000100:00080000:0.0:1789575504.302420:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575504.302593:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789575504.302604:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699335680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575504.302641:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575504.302711:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699335680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575504.302718:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789575504.302823:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc945180 x1876505699335680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575504.302845:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699335680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789575504.872786:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575505.324186:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789575505.324213:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699335808:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.324878:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.325014:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699335936:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.325056:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.325104:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335936 00000100:00100000:1.0:1789575505.325210:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699335808 00000100:00100000:1.0:1789575505.325223:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335808 00000100:00100000:1.0:1789575505.325292:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789575505.325303:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699335808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575505.325400:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699335808:12345-0@lo:400:kworker.0 Request processed in 99us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575505.325418:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789575505.326225:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699335936 00000100:00100000:2.0:1789575505.328208:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789575505.328226:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699335936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.328486:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699335936:12345-0@lo:400:kworker.0 Request processed in 267us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575505.328494:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789575505.328554:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699335936:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.328592:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699335808:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.329486:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699336064:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.329536:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.329587:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336064 00000100:00100000:2.0:1789575505.329595:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336064 00000100:00100000:2.0:1789575505.329671:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789575505.329680:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699336064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.329724:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699336064:12345-0@lo:400:kworker.0 Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575505.329731:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789575505.329749:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575505.329775:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699336064:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.329830:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699336192:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.329858:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.329894:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336192 00000100:00100000:2.0:1789575505.329898:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336192 00000100:00100000:2.0:1789575505.329926:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789575505.329932:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699336192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330001:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699336192:12345-0@lo:400:kworker.0 Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575505.330007:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789575505.330036:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f8380 x1876505699336192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575505.330047:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699336192:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330078:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699336320:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.330145:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336320 00000100:00100000:2.0:1789575505.330150:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336320 00000100:00100000:2.0:1789575505.330179:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789575505.330186:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699336320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330219:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699336320:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575505.330225:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789575505.330238:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575505.330256:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699336320:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330311:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699336448:0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575505.330364:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336448 00000100:00100000:2.0:1789575505.330393:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336448 00000100:00100000:2.0:1789575505.330425:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789575505.330431:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699336448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575505.330465:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699336448:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575505.330481:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789575505.330500:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789575505.330519:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96913f8380 x1876505699336448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575505.330529:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699336448:0@lo:400:kworker.0 00000001:02000400:0.0:1789575505.787794:0:10341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789575505.832599:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575505.832624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699336576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575505.832694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575505.838252:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336576 00000100:00100000:1.0:1789575505.838267:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336576 00000100:00100000:1.0:1789575505.838357:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789575505.838388:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699336576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575505.838441:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575505.838529:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699336576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575505.838537:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789575505.838746:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d9880 x1876505699336576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575505.838766:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699336576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575505.900679:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575506.920586:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575507.952696:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575508.968785:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575509.148842:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575509.148906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575509.148936:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575509.148973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575509.149000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575509.149031:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231552 00000100:00100000:2.0:1789575509.149042:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231552 00000100:00100000:2.0:1789575509.149117:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231680 00000100:00100000:2.0:1789575509.149121:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231680 00000100:00100000:2.0:1789575509.149148:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:2.0:1789575509.149160:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676231552:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575509.149245:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676231552:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 88us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575509.149253:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:2.0:1789575509.149271:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:2.0:1789575509.149278:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676231680:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575509.149302:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676231680:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575509.149308:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:2.0:1789575509.149349:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231936 00000100:00100000:2.0:1789575509.149352:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231936 00000100:00100000:2.0:1789575509.149431:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231808 00000100:00100000:2.0:1789575509.149437:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231808 00000100:00100000:2.0:1789575509.149483:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789575509.149498:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676231936:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575509.149550:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676231936:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 56us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575509.149563:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789575509.149585:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789575509.149599:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231808:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575509.149647:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676231808:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 50us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575509.149656:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00080000:2.0:1789575509.149694:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575509.149704:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789575509.149710:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575509.150234:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676231424 00000100:00100000:3.0:1789575509.150241:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676231424 00000100:00100000:3.0:1789575509.150275:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:3.0:1789575509.150283:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676231424:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575509.150332:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676231424:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 49us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575509.150338:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:0.0:1789575509.420778:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575509.426216:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699336704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575509.426530:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575509.434601:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336704 00000100:00100000:3.0:1789575509.434641:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336704 00000100:00100000:3.0:1789575509.434739:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789575509.434751:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699336704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575509.434828:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575509.434968:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699336704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 219us (8437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575509.434976:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789575509.435055:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789575509.435476:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc947100 x1876505699336704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575509.435514:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699336704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789575509.995599:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575510.441522:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699337216:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441601:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441664:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575510.441670:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699336832:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441698:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699337344:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441747:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441801:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699337088:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441827:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441845:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789575510.441850:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699336960:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441887:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699337472:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.441907:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575510.441950:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337216 00000100:00100000:2.0:1789575510.441958:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337216 00000100:00100000:2.0:1789575510.442002:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337472 00000100:00100000:2.0:1789575510.442005:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337472 00000100:00100000:2.0:1789575510.442036:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789575510.442036:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575510.442044:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699337216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.442115:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699337216:12345-0@lo:400:kworker.0 Request processed in 71us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575510.442125:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789575510.442159:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337344 00000100:00100000:1.0:1789575510.442164:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337344 00000100:00100000:2.0:1789575510.442177:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789575510.442183:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699337472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575510.442195:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337088 00000100:00100000:1.0:1789575510.442198:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337088 00000100:00100000:2.0:1789575510.442215:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699337472:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575510.442215:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336960 00000100:00100000:1.0:1789575510.442218:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336960 00000100:00100000:2.0:1789575510.442221:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789575510.442239:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699336832 00000100:00100000:1.0:1789575510.442242:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789575510.442243:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699336832 00000100:00100000:1.0:1789575510.442250:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.442269:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789575510.442274:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699336832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575510.442287:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699337344:12345-0@lo:400:kworker.0 Request processed in 39us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575510.442293:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789575510.442301:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699336832:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575510.442306:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789575510.442311:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699337088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.442318:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789575510.442335:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699337088:12345-0@lo:400:kworker.0 Request processed in 25us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575510.442341:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789575510.442350:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789575510.442356:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699336960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.442420:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699336960:12345-0@lo:400:kworker.0 Request processed in 63us (547us total) trans 0 rc 0/0 00000100:00080000:0.0:1789575510.442485:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575510.442517:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699336832:0@lo:400:kworker.0 00000100:00100000:0.0:1789575510.442530:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699337344:0@lo:400:kworker.0 00010000:00080000:0.0:1789575510.442541:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bcd91880 x1876505699337216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575510.442551:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699337216:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.455539:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789575510.455662:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699336960:0@lo:400:kworker.0 00010000:00080000:2.0:1789575510.455681:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bcd91c00 x1876505699337472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575510.455693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699337472:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.455706:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699337088:0@lo:400:kworker.0 00000100:00100000:2.0:1789575510.952533:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699337600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575510.952627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575510.961519:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337600 00000100:00100000:3.0:1789575510.961546:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337600 00000100:00100000:3.0:1789575510.961646:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789575510.961658:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699337600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575510.961712:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575510.961840:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699337600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (9212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575510.961848:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789575510.962259:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3daa00 x1876505699337600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575510.962286:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699337600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575511.022906:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575512.042922:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575513.070523:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575514.090954:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575514.253894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575514.253985:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232064 00000100:00100000:0.0:1789575514.253997:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232064 00000100:00100000:0.0:1789575514.254080:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:0.0:1789575514.254095:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676232064:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575514.254208:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676232064:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575514.254215:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:2.0:1789575514.268628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575514.268767:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232192 00000100:00100000:3.0:1789575514.268778:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232192 00000100:00100000:3.0:1789575514.268852:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:3.0:1789575514.268863:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676232192:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575514.268948:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676232192:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575514.268960:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00080000:1.0:1789575514.269788:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575514.270487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575514.270541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575514.270698:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232448 00000100:00100000:2.0:1789575514.270710:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232448 00000100:00100000:2.0:1789575514.270824:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232576 00000100:00100000:2.0:1789575514.270831:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232576 00000100:00100000:2.0:1789575514.270875:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789575514.270905:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676232448:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575514.271012:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676232448:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 112us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575514.271022:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789575514.271077:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789575514.271088:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676232576:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575514.271132:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676232576:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 45us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575514.271143:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00080000:3.0:1789575514.272005:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789575514.272013:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575514.272277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575514.272364:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232320 00000100:00100000:3.0:1789575514.272427:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232320 00000100:00100000:3.0:1789575514.272500:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:3.0:1789575514.272513:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676232320:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575514.272584:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676232320:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575514.272594:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00080000:1.0:1789575514.272713:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575514.538140:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699337728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575514.538226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575514.542569:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337728 00000100:00100000:3.0:1789575514.542589:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337728 00000100:00100000:3.0:1789575514.542674:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789575514.542685:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699337728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575514.542746:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575514.542840:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699337728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (4613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575514.542847:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789575514.542897:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d8000 x1876505699337728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575514.542920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699337728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789575514.543531:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575515.112660:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575515.561529:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699337984:0@lo:400:kworker.0 00000100:00100000:1.0:1789575515.561602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575515.561669:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699338496:0@lo:400:kworker.0 00000100:00100000:1.0:1789575515.561696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575515.561738:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575515.561744:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699338112:0@lo:400:kworker.0 00000100:00100000:1.0:1789575515.561765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575515.561794:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338496 00000100:00100000:1.0:1789575515.561802:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338496 00000100:00100000:1.0:1789575515.561863:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789575515.561873:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699338496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575515.561921:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699338496:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575515.561927:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789575515.561948:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789575515.561978:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58000 x1876505699338496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575515.561993:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699338496:0@lo:400:kworker.0 00000100:00100000:2.0:1789575515.562181:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337984 00000100:00100000:2.0:1789575515.562186:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337984 00000100:00100000:2.0:1789575515.562222:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338112 00000100:00100000:2.0:1789575515.562225:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338112 00000100:00100000:2.0:1789575515.562248:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789575515.562255:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699337984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575515.562294:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699337984:12345-0@lo:400:kworker.0 Request processed in 40us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575515.562300:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789575515.562311:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789575515.562316:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699338112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575515.562343:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699338112:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575515.562349:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789575515.562468:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699337856:0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562502:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575515.562536:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699338368:0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575515.562578:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575515.562589:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699338240:0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562609:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575515.562647:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338368 00000100:00100000:0.0:1789575515.562651:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338368 00000100:00100000:0.0:1789575515.562680:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789575515.562687:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562734:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699338368:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575515.562739:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789575515.562756:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338240 00000100:00100000:0.0:1789575515.562760:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338240 00000100:00100000:0.0:1789575515.562778:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789575515.562784:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562809:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699338240:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575515.562814:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789575515.562837:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58e00 x1876505699338240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575515.562847:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699338240:0@lo:400:kworker.0 00000100:00100000:0.0:1789575515.562856:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699338368:0@lo:400:kworker.0 00000100:00100000:2.0:1789575515.562991:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699337856 00000100:00100000:2.0:1789575515.562995:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699337856 00000100:00100000:2.0:1789575515.563028:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789575515.565024:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699337856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575515.565130:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699337856:12345-0@lo:400:kworker.0 Request processed in 122us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575515.565138:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789575515.565208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699337856:0@lo:400:kworker.0 00000100:00080000:1.0:1789575515.565352:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575515.565400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699338112:0@lo:400:kworker.0 00000100:00100000:1.0:1789575515.565412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699337984:0@lo:400:kworker.0 00000100:00100000:0.0:1789575516.078751:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575516.078776:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699338624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575516.078871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575516.078939:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338624 00000100:00100000:0.0:1789575516.078948:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338624 00000100:00100000:0.0:1789575516.078993:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789575516.079034:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699338624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575516.079073:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575516.079115:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699338624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575516.079122:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789575516.079167:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d9f80 x1876505699338624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575516.079186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699338624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789575516.142058:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575517.162430:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575518.188674:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575519.210396:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575519.377440:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575519.377488:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575519.377521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575519.377544:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575519.377566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575519.377595:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232832 00000100:00100000:0.0:1789575519.377605:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232832 00000100:00100000:0.0:1789575519.377669:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232960 00000100:00100000:0.0:1789575519.377671:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232960 00000100:00100000:0.0:1789575519.377712:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:0.0:1789575519.377723:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676232832:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575519.377817:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676232832:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 95us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575519.377826:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:0.0:1789575519.377844:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:0.0:1789575519.377850:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676232960:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575519.377873:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676232960:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575519.377897:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:1.0:1789575519.378036:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233088 00000100:00100000:1.0:1789575519.378040:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233088 00000100:00100000:1.0:1789575519.378083:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233216 00000100:00100000:1.0:1789575519.378087:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233216 00000100:00100000:1.0:1789575519.378127:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:1.0:1789575519.378141:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2354:x1876505676233088:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789575519.378162:0:6708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223831eb 00000100:00080000:1.0:1789575519.378174:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96bc891800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789575519.378228:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789575519.378664:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+2:2354:x1876505676233088:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 522us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575519.378672:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:1.0:1789575519.378699:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:1.0:1789575519.378707:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2354:x1876505676233216:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789575519.378722:0:6708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223831f2 00000100:00080000:1.0:1789575519.378728:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96bc890000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789575519.378753:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789575519.378979:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+2:2354:x1876505676233216:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 272us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575519.378986:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00080000:1.0:1789575519.379009:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575519.379014:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789575519.379017:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789575519.379034:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575519.379040:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575519.381863:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676232704 00000100:00100000:3.0:1789575519.381884:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676232704 00000100:00100000:3.0:1789575519.381956:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:3.0:1789575519.381977:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676232704:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575519.382056:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676232704:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 80us (4566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575519.382064:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:2.0:1789575519.658629:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699338752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575519.658717:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575519.659521:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338752 00000100:00100000:1.0:1789575519.659535:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338752 00000100:00100000:1.0:1789575519.659623:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789575519.659634:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699338752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575519.659689:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575519.659757:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699338752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575519.659784:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789575519.659874:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58000 x1876505699338752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575519.659896:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699338752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575519.659951:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575520.241739:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575520.688434:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699338880:0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.688515:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575520.688565:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699339392:0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.688622:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575520.688657:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575520.688675:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699339264:0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.688705:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575520.688986:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699338880 00000100:00100000:0.0:1789575520.688998:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699338880 00000100:00100000:0.0:1789575520.689053:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789575520.689063:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.689125:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699338880:12345-0@lo:400:kworker.0 Request processed in 62us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575520.689133:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789575520.689257:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339392 00000100:00100000:0.0:1789575520.689261:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339392 00000100:00100000:0.0:1789575520.689295:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789575520.689302:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699339392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.689361:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699339392:12345-0@lo:400:kworker.0 Request processed in 60us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575520.689401:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789575520.689597:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699338880:0@lo:400:kworker.0 00000100:00100000:0.0:1789575520.689612:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699339392:0@lo:400:kworker.0 00000100:00080000:0.0:1789575520.689651:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575520.691932:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339264 00000100:00100000:2.0:1789575520.691946:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339264 00000100:00100000:2.0:1789575520.692012:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789575520.692022:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692114:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699339264:12345-0@lo:400:kworker.0 Request processed in 93us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575520.692121:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789575520.692208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699339136:0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575520.692283:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789575520.692292:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699339008:0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692336:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575520.692356:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699339520:0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692415:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575520.692451:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339520 00000100:00100000:2.0:1789575520.692456:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339520 00000100:00100000:2.0:1789575520.692498:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789575520.692505:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699339520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692541:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699339520:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575520.692547:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789575520.692586:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58000 x1876505699339264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575520.692604:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699339264:0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692635:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339136 00000100:00100000:2.0:1789575520.692639:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339136 00000100:00100000:2.0:1789575520.692683:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339008 00000100:00100000:2.0:1789575520.692687:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339008 00000100:00100000:2.0:1789575520.692710:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789575520.692716:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699339136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692750:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699339136:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575520.692756:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789575520.692767:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789575520.692772:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692796:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699339008:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575520.692813:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789575520.692837:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789575520.692842:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575520.692956:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699339008:0@lo:400:kworker.0 00010000:00080000:2.0:1789575520.692967:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd58e00 x1876505699339520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575520.692975:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699339520:0@lo:400:kworker.0 00000100:00100000:2.0:1789575520.692987:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699339136:0@lo:400:kworker.0 00000001:00100000:0.0:1789575520.802734:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000020:00000080:0.0:1789575520.802747:0:7664:0:(genops.c:885:class_export_put()) final put ffff8e96bc895000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000020:00000080:2.0:1789575520.803049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc895000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 for lustre-OST0001 00000020:00000080:2.0:1789575520.803123:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bc890000 for lustre-OST0001 00000100:00100000:2.0:1789575521.193558:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699339648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575521.193687:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575521.194107:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339648 00000100:00100000:0.0:1789575521.194119:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339648 00000100:00100000:0.0:1789575521.194183:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789575521.194195:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699339648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575521.194235:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575521.194296:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699339648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575521.194303:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789575521.195984:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3d8000 x1876505699339648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575521.196013:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699339648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575521.256743:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575522.280476:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575523.311636:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789575523.349485:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000020:00000080:2.0:1789575523.349494:0:6734:0:(genops.c:885:class_export_put()) final put ffff8e96bc894000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000020:00000080:2.0:1789575523.349520:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc894000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 for lustre-OST0000 00000020:00000080:2.0:1789575523.349562:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bc891800 for lustre-OST0000 00010000:00010000:1.0:1789575524.328946:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575524.500736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575524.503552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575524.503663:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575524.503817:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233472 00000100:00100000:0.0:1789575524.503827:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233472 00000100:00100000:0.0:1789575524.503904:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233600 00000100:00100000:0.0:1789575524.503908:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233600 00000100:00100000:0.0:1789575524.503934:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:0.0:1789575524.503945:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676233472:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575524.504027:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676233472:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575524.504034:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:0.0:1789575524.504053:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:0.0:1789575524.504059:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676233600:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575524.504080:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676233600:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575524.504085:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00080000:1.0:1789575524.504881:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575524.507662:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233344 00000100:00100000:2.0:1789575524.507684:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233344 00000100:00100000:2.0:1789575524.507891:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:2.0:1789575524.507903:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676233344:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575524.508005:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676233344:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 103us (7282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575524.508012:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:2.0:1789575524.777159:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699339776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575524.777286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575524.778041:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339776 00000100:00100000:1.0:1789575524.778052:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339776 00000100:00100000:1.0:1789575524.778118:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789575524.778127:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699339776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575524.778166:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575524.778217:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699339776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575524.778222:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789575524.778271:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5bb80 x1876505699339776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575524.778290:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699339776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575524.782595:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575525.352688:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575525.800823:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575525.800847:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699340160:0@lo:400:kworker.0 00000100:00100000:3.0:1789575525.800920:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575525.800981:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699340032:0@lo:400:kworker.0 00000100:00100000:3.0:1789575525.801057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575525.801077:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575525.801082:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699340544:0@lo:400:kworker.0 00000100:00100000:3.0:1789575525.801119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575525.801127:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340160 00000100:00100000:2.0:1789575525.801135:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340160 00000100:00100000:3.0:1789575525.801149:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340032 00000100:00100000:3.0:1789575525.801152:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340032 00000100:00100000:2.0:1789575525.801187:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789575525.801196:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699340160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801204:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699339904:0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801237:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575525.801251:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699340160:12345-0@lo:400:kworker.0 Request processed in 57us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575525.801258:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789575525.801258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699340416:0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801277:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575525.801304:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575525.801325:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699340288:0@lo:400:kworker.0 00000100:00080000:0.0:1789575525.801341:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575525.801354:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340416 00000100:00100000:0.0:1789575525.801358:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340416 00000100:00100000:1.0:1789575525.801360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575525.801417:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699339904 00000100:00100000:1.0:1789575525.801422:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699339904 00000100:00100000:1.0:1789575525.801451:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789575525.801457:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699339904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801490:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699339904:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575525.801496:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789575525.801530:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340544 00000100:00100000:1.0:1789575525.801534:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340544 00000100:00100000:1.0:1789575525.801559:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340288 00000100:00100000:1.0:1789575525.801562:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340288 00000100:00100000:1.0:1789575525.801579:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789575525.801585:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699340544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801614:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699340544:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575525.801631:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789575525.801643:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789575525.801649:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699340288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801676:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699340288:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575525.801681:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1789575525.801725:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bcd93b80 x1876505699340288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575525.801738:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699340288:0@lo:400:kworker.0 00000100:00100000:1.0:1789575525.801758:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699339904:0@lo:400:kworker.0 00000100:00100000:3.0:1789575525.806825:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789575525.806854:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699340032:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789575525.808113:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd51500 x1876505699340544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575525.808135:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699340544:0@lo:400:kworker.0 00000100:00100000:2.0:1789575525.808153:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699340160:0@lo:400:kworker.0 00000100:00080000:2.0:1789575525.808264:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789575525.808271:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575525.809079:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699340032:12345-0@lo:400:kworker.0 Request processed in 2231us (8014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575525.809167:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789575525.809238:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699340032:0@lo:400:kworker.0 00000100:00100000:0.0:1789575525.812985:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789575525.813013:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699340416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575525.813136:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699340416:12345-0@lo:400:kworker.0 Request processed in 138us (11858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575525.813144:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789575525.813191:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699340416:0@lo:400:kworker.0 00000100:00100000:0.0:1789575526.315520:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575526.315544:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699340672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575526.315633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575526.315707:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340672 00000100:00100000:0.0:1789575526.315717:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340672 00000100:00100000:0.0:1789575526.315770:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789575526.315778:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699340672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575526.315820:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575526.315866:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699340672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575526.315872:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789575526.315913:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3daa00 x1876505699340672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575526.315945:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699340672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575526.377798:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575527.400696:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575528.427821:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789575528.564013:0:11049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789575529.448509:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575529.618095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575529.618143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575529.618182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575529.618266:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233984 00000100:00100000:3.0:1789575529.618276:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233984 00000100:00100000:3.0:1789575529.618342:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233856 00000100:00100000:3.0:1789575529.618346:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233856 00000100:00100000:3.0:1789575529.618402:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:3.0:1789575529.618412:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676233984:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575529.618490:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676233984:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 79us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575529.618497:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:3.0:1789575529.618513:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:3.0:1789575529.618520:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676233856:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575529.618544:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676233856:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575529.618563:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00080000:1.0:1789575529.618892:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575529.618946:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676233728 00000100:00100000:2.0:1789575529.618951:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676233728 00000100:00100000:2.0:1789575529.618991:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:2.0:1789575529.618998:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676233728:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575529.619034:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676233728:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 37us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575529.619040:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:2.0:1789575529.908126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699340800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575529.908219:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575529.917333:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340800 00000100:00100000:3.0:1789575529.917353:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340800 00000100:00100000:2.0:1789575529.919412:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789575529.919427:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699340800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575529.919507:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575529.919623:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699340800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (11403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575529.919631:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789575529.919699:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc3daa00 x1876505699340800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575529.919728:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699340800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789575529.920090:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575530.476245:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575530.922111:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699341056:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575530.922248:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699341568:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922277:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575530.922305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575530.922311:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699341184:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575530.922365:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341568 00000100:00100000:1.0:1789575530.922400:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341568 00000100:00100000:3.0:1789575530.922451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699341312:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922459:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789575530.922468:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699341568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575530.922491:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575530.922513:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789575530.922513:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699341568:12345-0@lo:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575530.922518:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699340928:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922521:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789575530.922534:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341312 00000100:00100000:1.0:1789575530.922538:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341312 00000100:00100000:3.0:1789575530.922544:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575530.922554:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789575530.922563:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699341440:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922585:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699341312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575530.922594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575530.922611:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699341312:12345-0@lo:400:kworker.0 Request processed in 28us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575530.922616:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789575530.922625:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bcd93b80 x1876505699341312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575530.922634:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341056 00000100:00100000:1.0:1789575530.922637:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341056 00000100:00100000:3.0:1789575530.922651:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699341312:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922658:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341184 00000100:00100000:1.0:1789575530.922660:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341184 00000100:00100000:1.0:1789575530.922676:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341440 00000100:00100000:1.0:1789575530.922678:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341440 00000100:00100000:3.0:1789575530.922679:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789575530.922688:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699341056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.922690:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789575530.922695:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699341184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575530.922719:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699341056:12345-0@lo:400:kworker.0 Request processed in 33us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575530.922719:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699341184:12345-0@lo:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575530.922726:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789575530.922994:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789575530.923009:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789575530.923015:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699341440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.923053:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699341440:12345-0@lo:400:kworker.0 Request processed in 39us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575530.923059:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789575530.923074:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575530.923079:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575530.923095:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699340928 00000100:00100000:1.0:1789575530.923100:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699340928 00000100:00100000:1.0:1789575530.923126:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789575530.923133:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699340928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.923162:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699340928:12345-0@lo:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575530.923174:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789575530.923219:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699340928:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.923228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699341440:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.923252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699341184:0@lo:400:kworker.0 00000100:00100000:1.0:1789575530.923260:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699341056:0@lo:400:kworker.0 00010000:00080000:1.0:1789575530.923270:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686982d80 x1876505699341568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575530.923278:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699341568:0@lo:400:kworker.0 00000100:00100000:1.0:1789575531.433034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575531.433056:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699341696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575531.433128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575531.433193:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699341696 00000100:00100000:1.0:1789575531.433202:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699341696 00000100:00100000:1.0:1789575531.433249:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789575531.433258:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699341696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575531.433293:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575531.433335:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699341696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575531.433342:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789575531.433399:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686982d80 x1876505699341696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575531.433417:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699341696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575531.497919:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789575532.464815:0:11196:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3e3cc2b0 20000000:00000080:2.0:1789575532.464840:0:11196:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96bbc81000 uarg=0000000000000000 20000000:01000000:2.0:1789575532.464884:0:11196:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789575532.464890:0:11196:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789575532.464895:0:11196:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789575532.468326:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789575532.468570:0:11196:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789575532.477301:0:11196:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789575532.477339:0:11196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477362:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238319e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477400:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223831ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477408:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223831ba expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477418:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477425:0:11196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477432:0:11196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477486:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.477504:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 12 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.477520:0:11196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699341824:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575532.479967:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.479992:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 12 pid: 5857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.480018:0:11196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699341952:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575532.480272:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.480281:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 18 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.480293:0:11196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342080:0@lo:104: 00000100:00100000:1.0:1789575532.480342:0:11196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789575532.480484:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.480493:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 18 pid: 5856 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.480501:0:11196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342208:0@lo:104: 00000100:00100000:1.0:1789575532.480524:0:11196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575532.487457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575532.487543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234112 00000100:00100000:2.0:1789575532.487567:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234112 00010000:00010000:2.0:1789575532.487620:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 13 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575532.487663:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789575532.487673:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676234112:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575532.487702:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575532.487712:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 13 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.487726:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 13 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.487772:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575532.487837:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676234112:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 164us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575532.487845:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789575532.489280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575532.491452:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234240 00000100:00100000:2.0:1789575532.491469:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234240 00010000:00010000:2.0:1789575532.491534:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 13 pid: 5857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575532.491593:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:2.0:1789575532.491604:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676234240:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575532.491624:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575532.491631:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 13 pid: 5857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.491647:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 13 pid: 5857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.491671:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575532.491755:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676234240:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 153us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575532.491764:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00010000:00010000:1.0:1789575532.493098:0:11196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 18 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.493122:0:11196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 18 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.493137:0:11196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342336:0@lo:104: 00000100:00100000:1.0:1789575532.493229:0:11196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575532.493710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342080 00000100:00100000:0.0:1789575532.493722:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342080 00000100:00100000:0.0:1789575532.493784:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342208 00000100:00100000:0.0:1789575532.493788:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342208 00000100:00100000:0.0:1789575532.493816:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575532.493826:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:11196:x1876505699342080:12345-0@lo:104: 00010000:00010000:0.0:1789575532.493842:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575532.493960:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789575532.493967:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+4:11196:x1876505699342080:12345-0@lo:104: Request processed in 142us (13624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575532.493974:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575532.493992:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575532.493999:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:11196:x1876505699342208:12345-0@lo:104: 00010000:00010000:0.0:1789575532.494007:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494174:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575532.494183:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494191:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575532.494202:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494212:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575532.494219:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575532.494225:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789575532.494264:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494271:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575532.494296:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494302:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f1a00/0xc45cc82a223831ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831c1 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494317:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575532.494321:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494326:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575532.494328:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494335:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575532.494352:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575532.494357:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789575532.494395:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494402:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575532.494409:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494415:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0e00/0xc45cc82a223831ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831b3 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.494425:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575532.494426:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575532.494428:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575532.494453:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699342464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575532.494490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575532.494528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789575532.494534:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699342592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575532.494586:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575532.494623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342464 00000100:00100000:2.0:1789575532.494629:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342464 00010000:00010000:2.0:1789575532.494653:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 19 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575532.494674:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342592 00000100:00100000:2.0:1789575532.494677:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342592 00010000:00010000:2.0:1789575532.494983:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 20 pid: 5856 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575532.495010:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789575532.495019:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+20:3308:x1876505699342464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575532.495032:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575532.495038:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 20 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.495049:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 20 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.495069:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575532.495102:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+20:3308:x1876505699342464:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575532.495108:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789575532.495124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789575532.495129:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699342592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575532.495141:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575532.495146:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 19 pid: 5856 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.495153:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 19 pid: 5856 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.495162:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575532.495184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699342592:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575532.495190:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789575532.495236:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699342592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575532.495245:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699342464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575532.495346:0:11196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789575532.495363:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031600/0xc45cc82a223831dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae596e expref: 12 pid: 5854 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.495399:0:11196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699341824:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575532.495411:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0200/0xc45cc82a223831c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5936 expref: 11 pid: 5857 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.495418:0:11196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699341952:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575532.495428:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1000/0xc45cc82a223831c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223831ba expref: 18 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.495435:0:11196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342080:0@lo:104: 00010000:00010000:1.0:1789575532.495443:0:11196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0400/0xc45cc82a223831b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223831ac expref: 17 pid: 5856 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.495451:0:11196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342208:0@lo:104: 00010000:00010000:0.0:1789575532.495571:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789575532.495579:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:11196:x1876505699342208:12345-0@lo:104: Request processed in 1580us (15053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575532.495586:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575532.495603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342336 00000100:00100000:0.0:1789575532.495608:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342336 00000100:00100000:0.0:1789575532.495629:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789575532.495635:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:11196:x1876505699342336:12345-0@lo:104: 00010000:00010000:0.0:1789575532.495646:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.495992:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575532.496046:0:11196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11196:1876505699342336:0@lo:104: 00010000:00010000:2.0:1789575532.496075:0:11196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575532.496134:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789575532.496141:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:30b00971-c2a0-490d-912f-6313f32cd11c+3:11196:x1876505699342336:12345-0@lo:104: Request processed in 505us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575532.496162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789575532.496223:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575532.496231:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496240:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575532.496243:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496253:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575532.496271:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575532.496277:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789575532.496322:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496330:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575532.496360:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496367:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9a00/0xc45cc82a2238319e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223831a5 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496426:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575532.496428:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575532.496429:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575532.496437:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575532.496451:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699342720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575532.496500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575532.496573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342720 00000100:00100000:1.0:1789575532.496578:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342720 00010000:00010000:1.0:1789575532.496599:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575532.496623:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575532.496630:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+17:3307:x1876505699342720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789575532.496640:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575532.496651:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496660:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496672:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1200/0xc45cc82a223831a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238319e expref: 17 pid: 5857 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496684:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.496997:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497005:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497012:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497019:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497025:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575532.497029:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497037:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.497246:0:11196:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575532.497255:0:11196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497569:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497578:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a223831f9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575532.497595:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575532.497665:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+16:3307:x1876505699342720:12345-0@lo:103:ldlm_bl.0 Request processed in 1033us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575532.497674:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789575532.497980:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699342720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575532.521507:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575533.552165:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575534.039556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575534.039592:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234368 00000100:00100000:1.0:1789575534.039602:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234368 00000100:00100000:1.0:1789575534.039654:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:1.0:1789575534.039664:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+11:5601:x1876505676234368:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575534.039684:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575534.039708:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5998 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.039737:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.039749:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.039758:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575534.039811:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234368:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 148us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.039827:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:1.0:1789575534.060284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575534.060523:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234496 00000100:00100000:2.0:1789575534.060552:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234496 00000100:00100000:2.0:1789575534.060661:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 239 00000100:00100000:2.0:1789575534.060676:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234496:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.062477:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234496:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 1791us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.062492:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 239 00000100:00100000:3.0:1789575534.071724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575534.071806:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234624 00000100:00100000:0.0:1789575534.071818:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234624 00000100:00100000:0.0:1789575534.071873:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:0.0:1789575534.071883:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234624:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.072118:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234624:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 234us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575534.072126:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:0.0:1789575534.085785:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575534.085910:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234752 00000100:00100000:1.0:1789575534.085926:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234752 00000100:00100000:1.0:1789575534.086026:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:1.0:1789575534.086038:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676234752:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575534.086059:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575534.086092:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae599f expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.086124:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.086137:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 13 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.086148:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:1.0:1789575534.086223:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676234752:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 186us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.086230:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:3.0:1789575534.091051:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575534.091207:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676234880 00000100:00100000:1.0:1789575534.091218:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676234880 00000100:00100000:1.0:1789575534.092178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:1.0:1789575534.092201:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676234880:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.092576:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676234880:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 381us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.092590:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:3.0:1789575534.098322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575534.098505:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235008 00000100:00100000:1.0:1789575534.098517:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235008 00000100:00100000:1.0:1789575534.098584:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 243 00000100:00100000:1.0:1789575534.098593:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676235008:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.098940:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676235008:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 347us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.098946:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 243 10000000:01000000:0.0:1789575534.254666:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575534.254676:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e95850a0800 from 7 10000000:01000000:0.0:1789575534.254681:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575534.254736:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.254748:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.254758:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575534.254784:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699342848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.254854:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.255346:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575534.255504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342848 00000100:00100000:1.0:1789575534.255512:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342848 00000100:00100000:1.0:1789575534.255677:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789575534.255688:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699342848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575534.255703:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575534.255717:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238320e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.255742:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.255753:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575534.255761:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0600, rc 0) 00000100:00100000:1.0:1789575534.255815:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699342848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.255822:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789575534.255913:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699342848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575534.255928:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.255948:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575534.256011:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699342976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.256042:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.256116:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575534.256200:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699342976 00000100:00100000:2.0:1789575534.256205:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699342976 00000100:00100000:2.0:1789575534.256227:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789575534.256234:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699342976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.256506:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699342976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.256520:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789575534.256698:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699342976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.256728:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.256765:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575534.256796:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690597e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575534.256857:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343104 00000100:00100000:2.0:1789575534.256862:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343104 00000100:00100000:2.0:1789575534.256891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789575534.256897:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699343104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.257032:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699343104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.257038:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789575534.257117:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789575534.257997:0:11247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789575534.258230:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789575534.258253:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575534.258263:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.258273:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575534.258284:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789575534.258287:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9683db2800 from 7 10000000:01000000:2.0:1789575534.258290:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789575534.258322:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.258331:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.258340:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575534.258359:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.258448:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575534.258476:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968652e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575534.258531:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343232 00000100:00100000:0.0:1789575534.258547:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343232 00000100:00100000:0.0:1789575534.258680:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789575534.258690:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699343232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575534.258702:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575534.258716:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238321c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.258740:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238321c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.258751:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238321c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.258760:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030800, rc 0) 00000100:00100000:0.0:1789575534.258802:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575534.258810:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789575534.258858:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575534.259182:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.259202:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575534.259255:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.259283:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.259306:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77480 going to sleep for 11 seconds 00000100:00100000:2.0:1789575534.259358:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343360 00000100:00100000:2.0:1789575534.259363:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343360 00000100:00100000:2.0:1789575534.259426:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789575534.259433:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.260010:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.260018:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789575534.260114:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.260149:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.260187:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.260219:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77480 going to sleep for 11 seconds 00000100:00100000:1.0:1789575534.260270:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343488 00000100:00100000:1.0:1789575534.260275:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343488 00000100:00100000:1.0:1789575534.260387:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789575534.260397:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.260574:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.260655:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789575534.260793:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789575534.261505:0:11248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789575534.261573:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789575534.261674:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789575534.261688:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.261701:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575534.261711:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575534.261713:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9689726000 from 7 10000000:01000000:0.0:1789575534.261716:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575534.261746:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.261765:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.261787:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575534.261806:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.261852:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.262250:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575534.262355:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343616 00000100:00100000:2.0:1789575534.262362:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343616 00000100:00100000:2.0:1789575534.262420:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789575534.262428:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699343616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575534.262439:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575534.262453:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238322a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.262476:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238322a expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.262486:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238322a expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575534.262494:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8600, rc 0) 00000100:00100000:2.0:1789575534.262548:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699343616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.262555:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789575534.262702:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575534.262715:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.262724:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575534.262771:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.262801:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.262911:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575534.262936:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343744 00000100:00100000:1.0:1789575534.262941:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343744 00000100:00100000:2.0:1789575534.263190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789575534.263209:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699343744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575534.263888:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699343744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 677us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575534.263897:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789575534.266912:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.266983:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575534.267067:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575534.272045:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575534.273833:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699343872 00000100:00100000:1.0:1789575534.273851:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699343872 00000100:00100000:1.0:1789575534.273921:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789575534.273933:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699343872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575534.274216:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690affc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699343872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 285us (7148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.274224:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789575534.276724:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699343872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789575534.279477:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789575534.279555:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789575534.279686:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789575534.279701:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575534.279713:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575534.571569:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575534.747288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575534.747395:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575534.761740:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235136 00000100:00100000:1.0:1789575534.761761:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235136 00000100:00080000:1.0:1789575534.762112:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575534.762195:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235264 00000100:00100000:1.0:1789575534.762200:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235264 00000100:00100000:1.0:1789575534.762249:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:1.0:1789575534.762262:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676235136:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575534.762411:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676235136:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 152us (15131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.762419:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:1.0:1789575534.762438:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:1.0:1789575534.762445:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676235264:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575534.762468:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676235264:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (15075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575534.762474:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00080000:1.0:1789575534.762488:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575535.019477:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575535.019506:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699344000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575535.019595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575535.019665:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344000 00000100:00100000:3.0:1789575535.019672:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344000 00000100:00100000:3.0:1789575535.019752:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789575535.019764:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699344000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575535.019811:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575535.019867:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699344000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575535.019875:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789575535.019909:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789575535.019944:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd50e00 x1876505699344000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575535.019978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699344000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575535.593504:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575536.046903:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699344128:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.047488:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575536.058401:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699344384:0@lo:400:kworker.0 00000100:00100000:2.0:1789575536.058481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575536.061192:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344384 00000100:00100000:3.0:1789575536.061206:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344384 00000100:00100000:3.0:1789575536.061283:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1789575536.061392:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575536.061443:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699344384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.061556:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699344384:12345-0@lo:400:kworker.0 Request processed in 265us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575536.061565:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789575536.061597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699344512:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.061634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575536.061764:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344128 00000100:00100000:3.0:1789575536.061769:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344128 00000100:00100000:3.0:1789575536.062101:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789575536.062108:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699344128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.062147:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690aff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699344128:12345-0@lo:400:kworker.0 Request processed in 40us (14662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575536.062153:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789575536.063931:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699344128:0@lo:400:kworker.0 00000100:00100000:0.0:1789575536.064058:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344512 00000100:00100000:0.0:1789575536.064067:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344512 00000100:00100000:0.0:1789575536.064126:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789575536.064137:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699344512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575536.064231:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699344512:12345-0@lo:400:kworker.0 Request processed in 97us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575536.064239:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789575536.064286:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bcd93b80 x1876505699344512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575536.064314:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699344512:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.064451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699344640:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.064495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575536.064567:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789575536.064575:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699344256:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.064598:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575536.064617:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699344768:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.064644:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575536.064668:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344768 00000100:00100000:3.0:1789575536.065361:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344768 00000100:00100000:3.0:1789575536.065454:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789575536.065464:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699344768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.065519:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699344768:12345-0@lo:400:kworker.0 Request processed in 58us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575536.065537:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789575536.065588:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b0e00 x1876505699344768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575536.065602:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699344768:0@lo:400:kworker.0 00000100:00100000:0.0:1789575536.065863:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344640 00000100:00100000:0.0:1789575536.065870:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344640 00000100:00100000:0.0:1789575536.065911:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344256 00000100:00100000:0.0:1789575536.065915:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344256 00000100:00100000:0.0:1789575536.065937:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789575536.066069:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699344640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575536.066115:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699344640:12345-0@lo:400:kworker.0 Request processed in 171us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575536.066122:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789575536.066134:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789575536.066152:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699344256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575536.066180:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699344256:12345-0@lo:400:kworker.0 Request processed in 29us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575536.066185:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789575536.066204:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789575536.066209:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575536.066414:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699344384:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.067034:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699344256:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.067046:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699344640:0@lo:400:kworker.0 00000100:00100000:3.0:1789575536.557332:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699344896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575536.557442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575536.557646:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699344896 00000100:00100000:2.0:1789575536.557657:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699344896 00000100:00100000:2.0:1789575536.557706:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789575536.557715:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699344896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575536.557751:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575536.557873:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699344896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575536.557881:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789575536.557952:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd50e00 x1876505699344896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575536.557971:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699344896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789575536.616583:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575537.640760:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789575538.007255:0:11395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789575538.664652:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575539.689673:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575539.864060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575539.864114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575539.864148:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575539.864182:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235520 00000100:00100000:1.0:1789575539.864193:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235520 00000100:00100000:1.0:1789575539.864248:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235648 00000100:00100000:1.0:1789575539.864266:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235648 00000100:00100000:1.0:1789575539.864295:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:1.0:1789575539.864304:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676235520:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575539.864409:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676235520:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575539.864417:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:1.0:1789575539.864435:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789575539.864442:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676235648:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575539.864469:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676235648:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575539.864475:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00080000:1.0:1789575539.864503:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575539.864591:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235392 00000100:00100000:0.0:1789575539.864597:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235392 00000100:00100000:0.0:1789575539.864628:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:0.0:1789575539.864634:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676235392:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575539.864663:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676235392:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575539.864668:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:2.0:1789575540.136687:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575540.136711:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575540.136785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575540.139942:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345024 00000100:00100000:3.0:1789575540.139961:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345024 00000100:00100000:3.0:1789575540.140052:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789575540.140063:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575540.140105:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575540.140238:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (3452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575540.140246:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789575540.140304:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd50e00 x1876505699345024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575540.140326:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789575540.140754:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575540.713009:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575541.173124:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699345280:0@lo:400:kworker.0 00000100:00100000:2.0:1789575541.173234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575541.173289:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699345792:0@lo:400:kworker.0 00000100:00100000:2.0:1789575541.173325:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575541.173365:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789575541.173391:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699345152:0@lo:400:kworker.0 00000100:00100000:2.0:1789575541.173422:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575541.173443:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699345664:0@lo:400:kworker.0 00000100:00100000:2.0:1789575541.173464:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575541.178127:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699345408:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575541.178274:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575541.178282:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345536:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575541.178350:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345280 00000100:00100000:3.0:1789575541.178359:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345280 00000100:00100000:3.0:1789575541.178429:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345664 00000100:00100000:3.0:1789575541.178433:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345664 00000100:00100000:3.0:1789575541.178464:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345408 00000100:00100000:3.0:1789575541.178467:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345408 00000100:00100000:3.0:1789575541.178499:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789575541.178509:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699345280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178570:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699345280:12345-0@lo:400:kworker.0 Request processed in 63us (5336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.178578:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789575541.178596:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789575541.178602:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178644:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699345664:12345-0@lo:400:kworker.0 Request processed in 41us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.178670:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789575541.178682:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789575541.178689:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699345408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178723:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699345408:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.178729:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789575541.178748:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345152 00000100:00100000:3.0:1789575541.178753:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345152 00000100:00100000:3.0:1789575541.178781:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789575541.178788:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699345152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.178834:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699345152:12345-0@lo:400:kworker.0 Request processed in 47us (5411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.178840:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789575541.178977:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345792 00000100:00100000:3.0:1789575541.178982:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345792 00000100:00100000:3.0:1789575541.179010:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345536 00000100:00100000:3.0:1789575541.179013:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345536 00000100:00100000:3.0:1789575541.179031:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789575541.179036:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699345792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.179069:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699345792:12345-0@lo:400:kworker.0 Request processed in 33us (5744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.179075:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789575541.179086:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789575541.179092:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.179120:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345536:12345-0@lo:400:kworker.0 Request processed in 28us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575541.179135:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789575541.179153:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789575541.179157:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575541.179190:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699345152:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.179204:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699345664:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.179214:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699345280:0@lo:400:kworker.0 00010000:00080000:3.0:1789575541.179225:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd8d880 x1876505699345792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575541.179235:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699345792:0@lo:400:kworker.0 00010000:00080000:3.0:1789575541.179267:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd5aa00 x1876505699345536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575541.179276:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345536:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.179285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699345408:0@lo:400:kworker.0 00000100:00100000:3.0:1789575541.672933:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575541.673010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575541.673149:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699345920 00000100:00100000:2.0:1789575541.673161:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699345920 00000100:00100000:2.0:1789575541.673220:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789575541.673230:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575541.673273:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575541.673329:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699345920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575541.673335:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789575541.673464:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b4700 x1876505699345920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575541.673499:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699345920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575541.736952:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575542.760794:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789575543.247501:0:11495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:19:01 (1789575541) === 00000100:00100000:1.0:1789575543.563650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575543.563730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575543.565170:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235904 00000100:00100000:2.0:1789575543.565195:0:5871:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235904 00000100:00100000:2.0:1789575543.565286:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:2.0:1789575543.565300:0:5871:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:9699:x1876505676235904:12345-192.168.202.32@tcp:700:mkdir.0 00000100:00080000:0.0:1789575543.565518:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575543.565802:0:5871:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:9699:x1876505676235904:12345-192.168.202.32@tcp:700:mkdir.0 Request processed in 505us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575543.565811:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789575543.566949:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676235776 00000100:00100000:3.0:1789575543.566964:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676235776 00000100:00100000:3.0:1789575543.567042:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575543.567053:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676235776:12345-192.168.202.32@tcp:41:mkdir.0 00000004:00000024:3.0:1789575543.567097:0:9231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789575543.567254:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676235776:12345-192.168.202.32@tcp:41:mkdir.0 Request processed in 202us (3618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575543.567278:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575543.582027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575543.582067:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676236160 00000100:00100000:3.0:1789575543.582079:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676236160 00000100:00100000:3.0:1789575543.582134:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575543.582143:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:9699:x1876505676236160:12345-192.168.202.32@tcp:36:mkdir.0 00010000:00010000:3.0:1789575543.582223:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575543.582254:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383119 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5921 expref: 6 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582273:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:3.0:1789575543.582284:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575543.582727:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582746:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582757:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582805:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582813:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.582819:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575543.585882:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789575543.585912:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585924:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585933:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585939:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.585945:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585955:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585974:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575543.585978:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.585983:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.585989:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383238 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575543.586013:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000370e76 reply state 000000007eb73d62 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575543.586022:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575543.586433:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9699:x1876505676236160:12345-192.168.202.32@tcp:36:mkdir.0 Request processed in 4286us (4416us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789575543.586471:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:0.0:1789575543.594285:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594310:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594318:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594325:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575543.594331:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594340:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594434:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9687bd8a00) 00010000:00010000:0.0:1789575543.594437:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575543.594443:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.594451:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a2238323f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575543.625991:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575543.626242:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676236288 00000100:00100000:1.0:1789575543.626255:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676236288 00000100:00100000:1.0:1789575543.626321:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:1.0:1789575543.626332:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:9700:x1876505676236288:12345-192.168.202.32@tcp:101:chmod.0 00010000:00010000:1.0:1789575543.626359:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575543.626443:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59a6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626544:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626559:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626572:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575543.626614:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789575543.626619:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575543.626665:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626696:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59a6 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626726:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59a6 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575543.626737:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e96831e1a00) 00010000:00010000:1.0:1789575543.626740:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789575543.626745:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:1.0:1789575543.626826:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9700:x1876505676236288:12345-192.168.202.32@tcp:101:chmod.0 Request processed in 495us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575543.626834:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:1.0:1789575543.635309:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575543.635431:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676236544 00000100:00100000:0.0:1789575543.635444:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676236544 00000100:00100000:0.0:1789575543.635522:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789575543.635533:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9700:x1876505676236544:12345-192.168.202.32@tcp:36:chmod.0 00010000:00010000:0.0:1789575543.635592:0:5864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575543.635627:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238324d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59a6 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.635654:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e96831e1a00) 00010000:00010000:0.0:1789575543.635666:0:5864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575543.635695:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.635708:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.635719:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575543.636088:0:5864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b4097e4 reply state 000000006c142704 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575543.636111:0:5864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789575543.636120:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789575543.636215:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:9700:x1876505676236544:12345-192.168.202.32@tcp:36:chmod.0 Request processed in 683us (920us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789575543.636222:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00010000:00010000:3.0:1789575543.639193:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639212:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639220:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639227:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.639232:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639239:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639254:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9c00) 00010000:00010000:3.0:1789575543.639257:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789575543.639261:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.639267:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383254 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575543.717518:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575543.717898:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676236672 00000100:00100000:3.0:1789575543.717909:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676236672 00000100:00100000:3.0:1789575543.717975:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:3.0:1789575543.717985:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9701:x1876505676236672:12345-192.168.202.32@tcp:101:chown.0 00010000:00010000:3.0:1789575543.718029:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575543.718256:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a2238325b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59ad expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718329:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718343:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718355:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575543.718430:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789575543.718435:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575543.718488:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718513:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a2238325b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ad expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718531:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ad expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.718540:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575543.718543:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575543.718546:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0a00, rc 0) 00000100:00100000:3.0:1789575543.718829:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:9701:x1876505676236672:12345-192.168.202.32@tcp:101:chown.0 Request processed in 843us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575543.718838:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789575543.734586:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575543.734810:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676236800 00000100:00100000:3.0:1789575543.734825:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676236800 00000100:00100000:3.0:1789575543.734906:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789575543.734918:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+8:9701:x1876505676236800:12345-192.168.202.32@tcp:101:chown.0 00010000:00010000:3.0:1789575543.734960:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575543.734992:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383269 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59b4 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735321:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735338:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735351:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735367:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735407:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735414:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735533:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735542:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735569:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575543.735606:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789575543.735610:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575543.735643:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735656:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735663:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735671:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735678:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.735683:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735692:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735705:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575543.735708:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.735714:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735721:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0800/0xc45cc82a22383270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735745:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735752:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735758:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735765:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.735768:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735776:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735785:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575543.735788:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.735790:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735796:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735835:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383269 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59b4 expref: 10 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735851:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59b4 expref: 9 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.735870:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575543.735872:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575543.735875:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575543.736289:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+9:9701:x1876505676236800:12345-192.168.202.32@tcp:101:chown.0 Request processed in 1370us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575543.736300:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789575543.761888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575543.762181:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237056 00000100:00100000:3.0:1789575543.762194:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237056 00000100:00100000:3.0:1789575543.762273:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575543.762284:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:9701:x1876505676237056:12345-192.168.202.32@tcp:36:chown.0 00010000:00010000:3.0:1789575543.762340:0:7184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575543.762416:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238327e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59b4 expref: 9 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.762441:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575543.762463:0:7184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575543.762499:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.762512:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.762522:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575543.786497:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789575543.834479:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1789575543.834506:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789575543.834613:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096d1846e reply state 00000000684a544f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575543.834630:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789575543.834650:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789575543.834937:0:7184:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789575543.834964:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9701:x1876505676237056:12345-192.168.202.32@tcp:36:chown.0 Request processed in 72676us (73091us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789575543.834975:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00010000:00010000:3.0:1789575543.835097:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835129:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835139:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835145:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.835151:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835159:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835184:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575543.835187:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789575543.835193:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.835199:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383285 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575543.909982:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575543.910123:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237184 00000100:00100000:0.0:1789575543.910137:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237184 00000100:00100000:0.0:1789575543.910213:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789575543.910224:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:9702:x1876505676237184:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:0.0:1789575543.910250:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575543.910276:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238328c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59bb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575543.923700:0:5863:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 13368us 00010000:00010000:3.0:1789575543.957402:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957427:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957443:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957470:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957486:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957493:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957933:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957943:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.957952:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575543.957977:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789575543.957980:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575543.958098:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958112:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958120:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958127:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958134:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.958139:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958153:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958167:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575543.958170:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.958176:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958182:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1c00/0xc45cc82a22383293 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958194:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958200:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958205:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958211:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.958213:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958219:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958226:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575543.958228:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.958230:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958246:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238329a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958286:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238328c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59bb expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958302:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59bb expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.958310:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575543.958313:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789575543.958315:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1200, rc 0) 00000100:00100000:3.0:1789575543.958425:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9702:x1876505676237184:12345-192.168.202.32@tcp:101:touch.500 Request processed in 48201us (48464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575543.958435:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789575543.962440:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575543.962546:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237440 00000100:00100000:0.0:1789575543.962560:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237440 00000100:00100000:0.0:1789575543.962624:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789575543.962652:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+7:9702:x1876505676237440:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:0.0:1789575543.962678:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575543.962702:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223832a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59c2 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963044:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963063:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963074:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963089:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963096:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.963104:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575543.963859:0:9231:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789575543.964152:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223832bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964164:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223832bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964173:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223832bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964216:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964224:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964230:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964236:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575543.964240:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964249:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964260:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575543.964263:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575543.964268:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964274:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575543.964289:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036dc8f09 reply state 00000000b6c4b75b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575543.964298:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789575543.964337:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223832a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c2 expref: 10 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964367:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223832bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c2 expref: 9 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575543.964406:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687dc9100) 00010000:00010000:0.0:1789575543.964409:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575543.964411:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575543.964511:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+10:9702:x1876505676237440:12345-192.168.202.32@tcp:101:touch.500 Request processed in 1861us (2084us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789575543.964519:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00010000:00010000:3.0:1789575543.979667:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979689:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979698:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979706:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.979712:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979751:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979789:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff8e9687dc9e00) 00010000:00010000:3.0:1789575543.979793:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.979799:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.979806:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223832b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575543.980516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575543.981436:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237696 00000100:00100000:3.0:1789575543.981461:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237696 00000100:00100000:3.0:1789575543.981546:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575543.981557:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:9702:x1876505676237696:12345-192.168.202.32@tcp:36:touch.500 00010000:00010000:3.0:1789575543.981631:0:7184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575543.981661:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223832bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c2 expref: 9 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.981682:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687dc9100) 00010000:00010000:3.0:1789575543.981694:0:7184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575543.981745:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.981762:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.981773:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575543.983328:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c243666f reply state 00000000db365e13 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575543.983347:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575543.984977:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+10:9702:x1876505676237696:12345-192.168.202.32@tcp:36:touch.500 Request processed in 3409us (4454us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789575543.984991:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00010000:00010000:3.0:1789575543.988214:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988234:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988242:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988248:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575543.988253:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988262:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988279:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575543.988282:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575543.988286:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575543.988293:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575544.006737:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575544.008232:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237824 00000100:00100000:3.0:1789575544.008246:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237824 00000100:00100000:3.0:1789575544.008316:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789575544.008326:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:9702:x1876505676237824:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:3.0:1789575544.008351:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575544.008416:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59c9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575544.008489:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c9 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575544.008505:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c9 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575544.008524:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575544.008528:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575544.008531:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575544.008588:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:9702:x1876505676237824:12345-192.168.202.32@tcp:101:touch.500 Request processed in 264us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575544.008596:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789575544.018321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575544.018471:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676237952 00000100:00100000:3.0:1789575544.018484:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676237952 00000100:00100000:3.0:1789575544.018541:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:3.0:1789575544.018550:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876505676237952:12345-192.168.202.32@tcp:8:touch.500 00010000:00080000:3.0:1789575544.018590:0:6708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1789575544.018629:0:6708:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a223832d9 00002000:00100000:3.0:1789575544.018660:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22a2b54c-4bca-4302-892e-490c3310b8b3/ffff8e96878e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575544.018692:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575544.019263:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789575544.019299:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96878e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575544.019481:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676237952:12345-192.168.202.32@tcp:8:touch.500 Request processed in 898us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575544.019490:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:1.0:1789575544.030508:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575544.030881:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676238080 00000100:00100000:3.0:1789575544.030894:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676238080 00000100:00100000:3.0:1789575544.030986:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789575544.030999:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:0:x1876505676238080:12345-192.168.202.32@tcp:2:touch.500 00000100:00080000:0.0:1789575544.031885:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789575544.084522:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789575544.084544:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000100:00100000:0.0:1789575544.084875:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:0:x1876505676238080:12345-192.168.202.32@tcp:2:touch.500 Request processed in 53872us (54372us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789575544.084888:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789575544.089150:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575544.089550:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676238336 00000100:00100000:1.0:1789575544.089561:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676238336 00000100:00100000:1.0:1789575544.091137:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789575544.091150:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+10:9702:x1876505676238336:12345-192.168.202.32@tcp:35:touch.500 00000100:00100000:1.0:1789575544.091598:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+11:9702:x1876505676238336:12345-192.168.202.32@tcp:35:touch.500 Request processed in 449us (2459us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789575544.091606:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:2.0:1789575544.135895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575544.135974:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676238464 00000100:00100000:1.0:1789575544.135989:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676238464 00000100:00100000:1.0:1789575544.136281:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789575544.136293:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+11:9703:x1876505676238464:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:1.0:1789575544.136321:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575544.136344:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1000/0xc45cc82a223832e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59d0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136520:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136539:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136554:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575544.136604:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575544.136608:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575544.136659:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136692:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1000/0xc45cc82a223832e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59d0 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136720:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59d0 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.136729:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575544.136732:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575544.136736:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8000, rc 0) 00000100:00100000:2.0:1789575544.136818:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+12:9703:x1876505676238464:12345-192.168.202.32@tcp:101:rm.0 Request processed in 528us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575544.136826:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789575544.140994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575544.141808:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676238720 00000100:00100000:0.0:1789575544.141825:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676238720 00000100:00100000:0.0:1789575544.141901:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789575544.141914:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+12:9703:x1876505676238720:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:0.0:1789575544.141942:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575544.141967:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223832ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59d7 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575544.142087:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789575544.142405:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223832ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59d7 expref: 14 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.142421:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:0.0:1789575544.142424:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575544.142431:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223832ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59d7 expref: 14 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.142456:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077e00, rc 0) 00000100:00100000:0.0:1789575544.142543:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:9703:x1876505676238720:12345-192.168.202.32@tcp:101:rm.0 Request processed in 632us (1561us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789575544.142552:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789575544.150978:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575544.152568:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676238848 00000100:00100000:1.0:1789575544.152588:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676238848 00000100:00100000:1.0:1789575544.152726:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:1.0:1789575544.152739:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+13:9703:x1876505676238848:12345-192.168.202.32@tcp:37:rm.0 00000100:00100000:1.0:1789575544.163125:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+13:9703:x1876505676238848:12345-192.168.202.32@tcp:37:rm.0 Request processed in 9555us (11329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575544.163142:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789575544.176710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575544.176948:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676239104 00000100:00100000:2.0:1789575544.176960:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676239104 00000100:00100000:2.0:1789575544.177030:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:2.0:1789575544.177043:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:9703:x1876505676239104:12345-192.168.202.32@tcp:35:rm.0 00000100:00100000:2.0:1789575544.177478:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+14:9703:x1876505676239104:12345-192.168.202.32@tcp:35:rm.0 Request processed in 437us (782us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789575544.177487:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789575544.185245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575544.185481:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676239360 00000100:00100000:0.0:1789575544.185495:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676239360 00000100:00100000:0.0:1789575544.185577:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789575544.185589:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+14:9703:x1876505676239360:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:0.0:1789575544.185621:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575544.185649:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59de expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.185909:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383303 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.185926:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.185939:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575544.185967:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789575544.186151:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223832fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59de expref: 17 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.186173:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383303 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59de expref: 16 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.186182:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575544.186185:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789575544.186189:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575544.186466:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676239360:12345-192.168.202.32@tcp:101:rm.0 Request processed in 878us (1233us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789575544.186474:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789575544.199620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575544.199820:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676239488 00000100:00100000:2.0:1789575544.199836:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676239488 00000100:00100000:2.0:1789575544.199913:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789575544.199926:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676239488:12345-192.168.202.32@tcp:41:rm.0 00000004:00000024:2.0:1789575544.200457:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789575544.200560:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676239488:12345-192.168.202.32@tcp:41:rm.0 Request processed in 635us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575544.200569:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:3.0:1789575544.206485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575544.206615:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676239616 00000100:00100000:0.0:1789575544.206627:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676239616 00000100:00100000:0.0:1789575544.206697:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789575544.206711:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676239616:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:0.0:1789575544.206742:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575544.206772:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59e5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206867:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206886:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206927:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206949:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206957:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.206963:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207109:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207118:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207126:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575544.207161:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789575544.207167:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575544.207190:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207205:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207214:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207230:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207238:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207244:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575544.207250:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207258:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207274:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575544.207277:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575544.207284:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207291:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383318 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207308:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207314:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207321:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207326:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575544.207334:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207341:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207348:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff8e9687dc9100) 00010000:00010000:0.0:1789575544.207351:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575544.207353:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207358:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238331f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207483:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59e5 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207500:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59e5 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.207508:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575544.207511:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575544.207514:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077c00, rc 0) 00000100:00100000:0.0:1789575544.207605:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+17:9703:x1876505676239616:12345-192.168.202.32@tcp:101:rm.0 Request processed in 897us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575544.207613:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:3.0:1789575544.211492:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575544.213417:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676239872 00000100:00100000:0.0:1789575544.213438:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676239872 00000100:00100000:0.0:1789575544.213555:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789575544.213570:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+17:9703:x1876505676239872:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:0.0:1789575544.213682:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789575544.213725:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59e5 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213756:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223832d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59c9 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213770:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575544.213790:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223832e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59d0 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213800:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575544.213804:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575544.213829:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213845:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213859:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213875:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213882:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.213889:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.214044:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.214052:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.214060:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789575544.214977:0:9231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789575544.214993:0:9231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356301621619ns, next at 357301618035ns, rc = 0 00010000:00010000:0.0:1789575544.215080:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215094:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215104:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215112:0:9231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215118:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215125:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215162:0:9231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789575544.215186:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215202:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215208:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215214:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575544.215218:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215225:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215235:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687dc9c00) 00010000:00010000:0.0:1789575544.215238:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789575544.215243:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215249:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156000/0xc45cc82a2238333b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215272:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215278:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215283:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215288:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575544.215297:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215303:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215311:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575544.215313:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575544.215315:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.215321:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238332d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575544.215331:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e89dc8c1 reply state 00000000000323ab transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575544.215340:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789575544.215512:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676239872:12345-192.168.202.32@tcp:36:rm.0 Request processed in 1942us (4031us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789575544.215524:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00010000:00010000:1.0:1789575544.215766:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575544.215776:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.215785:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575544.215789:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.215797:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.215807:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9687dc9c00) 00010000:00010000:1.0:1789575544.215809:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789575544.215813:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.215818:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157a00/0xc45cc82a22383342 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.215837:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575544.215840:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575544.215841:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575544.226664:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226689:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226697:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226704:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575544.226709:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226733:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226751:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2036a5dd (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575544.226755:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575544.226760:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575544.226768:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2036a5dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575544.229537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575544.229987:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240128 00000100:00100000:1.0:1789575544.229999:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240128 00000100:00100000:1.0:1789575544.230060:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789575544.230070:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+15:9703:x1876505676240128:12345-192.168.202.32@tcp:35:rm.0 00000100:00100000:1.0:1789575544.230312:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676240128:12345-192.168.202.32@tcp:35:rm.0 Request processed in 242us (786us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789575544.230320:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789575544.234313:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575544.234515:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240384 00000100:00100000:2.0:1789575544.234528:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240384 00000100:00100000:2.0:1789575544.234601:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789575544.234612:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+16:9703:x1876505676240384:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:2.0:1789575544.234681:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789575544.234715:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59de expref: 16 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234742:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223832a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59bb expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234755:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575544.234773:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383262 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ad expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234804:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575544.234810:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575544.234834:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234847:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234858:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234870:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234876:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.234882:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235134:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235143:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235150:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575544.235794:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789575544.235812:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235827:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235834:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235839:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575544.235844:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235851:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235861:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9683773000) 00010000:00010000:2.0:1789575544.235863:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789575544.235867:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235873:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383357 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235891:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235896:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235902:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235907:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575544.235914:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235920:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235928:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773500) 00010000:00010000:2.0:1789575544.235930:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575544.235932:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.235938:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383349 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575544.235949:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050037645 reply state 000000008809925b transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575544.235958:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575544.236052:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+15:9703:x1876505676240384:12345-192.168.202.32@tcp:36:rm.0 Request processed in 1439us (1746us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789575544.236061:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00010000:00010000:1.0:1789575544.238359:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238424:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238432:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238439:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575544.238443:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238461:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238478:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9683773d00) 00010000:00010000:1.0:1789575544.238481:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575544.238485:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575544.238492:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383350 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575544.808705:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575544.979556:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575544.979653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575544.979686:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575544.980231:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240768 00000100:00100000:1.0:1789575544.980242:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240768 00000100:00100000:1.0:1789575544.980327:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:1.0:1789575544.980338:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676240768:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575544.980437:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676240768:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 100us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575544.980454:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:2.0:1789575544.981856:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240640 00000100:00100000:2.0:1789575544.981871:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240640 00000100:00100000:2.0:1789575544.981943:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789575544.981952:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676240640:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575544.982030:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676240640:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 78us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575544.982037:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00080000:3.0:1789575544.982539:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575544.998406:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240512 00000100:00100000:0.0:1789575544.998424:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240512 00000100:00100000:0.0:1789575544.998501:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 256 00000100:00100000:0.0:1789575544.998511:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676240512:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575544.998594:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676240512:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (19057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575544.998601:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 256 00000100:00100000:1.0:1789575545.257647:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575545.257685:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699346048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575545.257787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575545.261716:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346048 00000100:00100000:2.0:1789575545.261751:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346048 00000100:00100000:2.0:1789575545.261861:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789575545.261872:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699346048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575545.261913:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575545.262005:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699346048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575545.262013:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789575545.262665:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789575545.265492:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b7800 x1876505699346048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575545.265523:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699346048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789575545.842463:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575546.282260:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699346304:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282394:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575546.282477:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699346816:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282511:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575546.282558:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789575546.282567:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699346176:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282600:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575546.282622:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699346688:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282646:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575546.282683:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346304 00000100:00100000:3.0:1789575546.282691:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346304 00000100:00100000:3.0:1789575546.282743:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346688 00000100:00100000:3.0:1789575546.282747:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346688 00000100:00100000:3.0:1789575546.282780:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789575546.282789:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282853:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699346304:12345-0@lo:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575546.282860:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789575546.282877:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789575546.282884:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.282911:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699346688:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575546.282917:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789575546.282935:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346176 00000100:00100000:3.0:1789575546.282939:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346176 00000100:00100000:3.0:1789575546.282965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789575546.282972:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699346176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.283002:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699346176:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575546.283019:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1789575546.283049:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575546.283081:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699346176:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.283095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699346688:0@lo:400:kworker.0 00000100:00100000:3.0:1789575546.283104:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699346304:0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283210:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699346432:0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575546.283270:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575546.283277:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699346560:0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575546.283330:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346816 00000100:00100000:1.0:1789575546.283334:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346816 00000100:00100000:1.0:1789575546.283400:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346560 00000100:00100000:1.0:1789575546.283404:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346560 00000100:00100000:1.0:1789575546.283436:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789575546.283443:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283485:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699346816:12345-0@lo:400:kworker.0 Request processed in 42us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575546.283492:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789575546.283505:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789575546.283511:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699346560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283542:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699346560:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575546.283547:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789575546.283563:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346432 00000100:00100000:1.0:1789575546.283565:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346432 00000100:00100000:1.0:1789575546.283600:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789575546.283605:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699346432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283635:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699346432:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575546.283640:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789575546.283665:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575546.283668:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789575546.283689:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9686981500 x1876505699346560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575546.283701:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699346560:0@lo:400:kworker.0 00000100:00100000:1.0:1789575546.283711:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699346432:0@lo:400:kworker.0 00010000:00080000:1.0:1789575546.283738:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd50e00 x1876505699346816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575546.283748:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699346816:0@lo:400:kworker.0 00000004:00080000:3.0:1789575546.794959:0:7870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358881584340ns, next at 359881581405ns, rc = 0 00000100:00100000:3.0:1789575546.794983:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575546.795005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699346944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575546.795078:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575546.795160:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699346944 00000100:00100000:3.0:1789575546.795170:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699346944 00000100:00100000:3.0:1789575546.795229:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789575546.795238:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699346944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575546.795292:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575546.795341:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699346944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575546.795348:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789575546.795443:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc406680 x1876505699346944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575546.795465:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699346944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575546.856524:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575547.880631:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575548.906994:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789575548.918629:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1789575548.918644:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789575548.918674:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:1.0:1789575548.918683:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789575548.918691:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1789575548.919253:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699347072:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789575548.919327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575548.919974:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347072 00000100:00100000:1.0:1789575548.919984:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347072 00000100:00100000:1.0:1789575548.920093:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789575548.920103:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699347072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789575548.920131:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789575548.920168:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aaac178, atime: 0x6aaac178, ctime: 0x6aaac178, blocks: 0x1 00010000:00010000:1.0:1789575548.920191:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575548.920210:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789575548.920214:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575548.920220:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575548.920238:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575548.920249:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575548.920257:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575548.920280:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575548.921047:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575548.921056:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575548.921066:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575548.921070:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575548.921081:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575548.921104:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575548.921112:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000af68816/0xc45cc82a2238335e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575548.921135:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575548.921145:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575548.921147:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575548.921337:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699347072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1233us (2007us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789575548.921346:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789575548.921494:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789575548.921669:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96913f9500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789575548.921677:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699347072:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789575549.437059:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:02000400:3.0:1789575549.781639:0:11648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789575549.928602:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575550.093227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575550.093271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575550.093414:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676240896 00000100:00100000:3.0:1789575550.093425:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676240896 00000100:00100000:3.0:1789575550.093484:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 258 00000100:00100000:3.0:1789575550.093495:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676240896:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575550.093571:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676240896:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 79us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575550.093580:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 258 00000100:00100000:1.0:1789575550.095694:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575550.095730:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575550.095768:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241024 00000100:00100000:1.0:1789575550.095778:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241024 00000100:00100000:1.0:1789575550.095843:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241280 00000100:00100000:1.0:1789575550.095861:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241280 00000100:00100000:1.0:1789575550.095891:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:1.0:1789575550.095902:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676241024:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575550.095976:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676241024:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575550.095983:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:1.0:1789575550.096001:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789575550.096007:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676241280:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575550.096034:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676241280:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575550.096040:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00080000:3.0:1789575550.097193:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575550.099426:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241152 00000100:00100000:2.0:1789575550.099450:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241152 00000100:00100000:3.0:1789575550.102289:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789575550.102303:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676241152:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575550.102428:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676241152:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 126us (9154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575550.102436:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00080000:2.0:1789575550.107496:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575550.377569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575550.377643:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575550.377717:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347200 00000100:00100000:3.0:1789575550.377725:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347200 00000100:00100000:3.0:1789575550.377851:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789575550.377863:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699347200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575550.377901:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789575550.378199:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575550.381414:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699347200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3513us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575550.381430:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789575550.381916:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b7b80 x1876505699347200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575550.383340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699347200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789575550.957994:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789575551.220328:0:11696:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb5878470 20000000:00000080:1.0:1789575551.220346:0:11696:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96bb587000 uarg=0000000000000000 20000000:01000000:1.0:1789575551.220433:0:11696:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789575551.220439:0:11696:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789575551.220444:0:11696:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789575551.226864:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789575551.227097:0:11696:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789575551.233754:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789575551.233812:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789575551.233971:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789575551.233995:0:11696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789575551.234023:0:11696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234047:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234055:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234073:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238320e expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234079:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238321c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234086:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234094:0:11696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234136:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234152:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.234167:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347328:0@lo:104: 00000100:00100000:1.0:1789575551.234235:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789575551.234302:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.234311:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 18 pid: 5856 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.234321:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347456:0@lo:104: 00000100:00100000:3.0:1789575551.234450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347328 00000100:00100000:3.0:1789575551.234468:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347328 00000100:00100000:3.0:1789575551.234519:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575551.234529:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347328:12345-0@lo:104: 00010000:00010000:3.0:1789575551.234544:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.237183:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575551.237311:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575551.237323:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347328:12345-0@lo:104: Request processed in 2793us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.237346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789575551.237446:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575551.237459:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.237469:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575551.237474:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.237485:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575551.237495:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575551.237501:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789575551.237564:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.237572:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575551.237576:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.237597:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.237606:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680030e00/0xc45cc82a2238322a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383231 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.237609:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.237627:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347712:0@lo:104: 00010000:00010000:3.0:1789575551.237638:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575551.237642:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575551.237643:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575551.237676:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575551.237834:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347456 00000100:00100000:2.0:1789575551.237843:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347456 00000100:00100000:2.0:1789575551.237894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789575551.237902:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347456:12345-0@lo:104: 00010000:00010000:2.0:1789575551.237914:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.237971:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575551.237978:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347456:12345-0@lo:104: Request processed in 76us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.237985:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789575551.238096:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575551.238102:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238109:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575551.238112:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238120:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575551.238127:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575551.238132:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789575551.238159:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238164:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575551.238173:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238181:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238189:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8400/0xc45cc82a2238321c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383223 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.238190:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 12 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.238212:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575551.238212:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347968:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575551.238222:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575551.238225:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575551.238283:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.238293:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 12 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.238301:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699348096:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575551.238324:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575551.238459:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699347840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575551.238528:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347328:0@lo:104: 00000100:00100000:0.0:1789575551.238572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347712 00000100:00100000:0.0:1789575551.238585:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347712 00000100:00100000:0.0:1789575551.238618:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789575551.238662:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575551.238776:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347456:0@lo:104: 00000100:00100000:2.0:1789575551.238805:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347840 00000100:00100000:2.0:1789575551.238809:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347840 00010000:00010000:2.0:1789575551.238931:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 19 pid: 5856 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575551.238973:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575551.238980:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699347840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575551.238991:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575551.238996:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 19 pid: 5856 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.239006:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 19 pid: 5856 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.239021:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030800/0xc45cc82a22383223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238321c expref: 19 pid: 5856 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.239034:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575551.239062:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+18:3306:x1876505699347840:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.239069:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575551.239098:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699347840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575551.239121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789575551.239130:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96878c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347712:12345-0@lo:104: 00010000:00010000:2.0:1789575551.239139:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.239179:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575551.239184:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96878c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:30b00971-c2a0-490d-912f-6313f32cd11c+3:11696:x1876505699347712:12345-0@lo:104: Request processed in 57us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.239190:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789575551.239274:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347712:0@lo:104: 00000100:00100000:0.0:1789575551.239318:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699347584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575551.239624:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575551.239632:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.239640:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575551.239645:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.239653:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575551.239660:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575551.239665:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789575551.242130:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575551.242269:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699347584 00000100:00100000:1.0:1789575551.242280:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699347584 00010000:00010000:1.0:1789575551.242323:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575551.242407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789575551.242417:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+18:3309:x1876505699347584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789575551.242433:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575551.242438:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.242451:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.242469:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9687ef8600/0xc45cc82a22383231 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238322a expref: 18 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.242483:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575551.242540:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+17:3309:x1876505699347584:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575551.242547:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789575551.242776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699347584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575551.243623:0:8472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.243640:0:8472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575551.243685:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.243693:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680031600/0xc45cc82a2238320e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22383215 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.243711:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575551.243713:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575551.243716:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575551.243855:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575551.243888:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699348224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575551.243964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575551.250714:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348224 00000100:00100000:3.0:1789575551.250751:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348224 00010000:00010000:3.0:1789575551.250798:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575551.250851:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789575551.250861:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+17:3306:x1876505699348224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575551.250878:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575551.250885:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.250899:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.250917:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0600/0xc45cc82a22383215 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238320e expref: 17 pid: 5854 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.250933:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575551.250997:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+16:3306:x1876505699348224:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (7033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575551.251004:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789575551.251048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699348224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789575551.251131:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575551.251209:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575551.251266:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241408 00000100:00100000:2.0:1789575551.251271:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241408 00010000:00010000:2.0:1789575551.251291:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 13 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575551.251318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241536 00000100:00100000:2.0:1789575551.251321:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241536 00010000:00010000:2.0:1789575551.251434:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 14 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575551.256063:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:3.0:1789575551.256096:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+14:2357:x1876505676241408:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575551.256121:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575551.256134:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 14 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.256151:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 14 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.256193:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0400/0xc45cc82a22383207 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae599f expref: 14 pid: 5857 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575551.256214:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575551.256298:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676241408:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 217us (5168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575551.265740:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699347968:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575551.265801:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1876505699348096:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575551.265846:0:11696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575551.267903:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789575551.267925:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676241536:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575551.267948:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575551.267957:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 13 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.267975:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 13 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.267997:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22383200 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5998 expref: 13 pid: 5854 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268017:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268585:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268611:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268619:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268628:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268635:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268641:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575551.268646:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268654:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268680:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575551.268693:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575551.268802:0:11696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.268817:0:11696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575551.268824:0:11696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0800/0xc45cc82a22383365 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575551.269221:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789575551.269424:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+11:2358:x1876505676241536:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1506us (18211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.269433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789575551.401572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699348608:0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.401648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575551.401708:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575551.401714:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699348736:0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.401739:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575551.401773:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348608 00000100:00100000:3.0:1789575551.401782:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348608 00000100:00100000:3.0:1789575551.401833:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575551.401842:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699348608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.401896:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699348608:12345-0@lo:400:kworker.0 Request processed in 55us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575551.401903:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575551.401927:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348736 00000100:00100000:3.0:1789575551.401931:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348736 00000100:00100000:3.0:1789575551.401965:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789575551.401971:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699348736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.402000:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699348736:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575551.402006:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789575551.402141:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699348480:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402179:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575551.402212:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789575551.402218:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699348352:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402240:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575551.402258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699348864:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402276:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575551.402302:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348480 00000100:00100000:2.0:1789575551.402305:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348480 00000100:00100000:2.0:1789575551.402333:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348352 00000100:00100000:2.0:1789575551.402336:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348352 00000100:00100000:2.0:1789575551.402349:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789575551.402355:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699348480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402420:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699348480:12345-0@lo:400:kworker.0 Request processed in 65us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.402427:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789575551.402439:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789575551.402445:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402471:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699348352:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575551.402476:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789575551.402517:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699348352:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402527:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699348480:0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.402585:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348864 00000100:00100000:3.0:1789575551.402588:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348864 00000100:00100000:3.0:1789575551.402619:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789575551.402627:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575551.402659:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699348864:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575551.402664:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789575551.402675:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789575551.402679:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575551.402699:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699348736:0@lo:400:kworker.0 00010000:00080000:3.0:1789575551.402710:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc407480 x1876505699348608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575551.402719:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699348608:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.402823:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789575551.402829:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96913f9500, transno 4294967300 00000100:00100000:2.0:1789575551.402882:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699348864:0@lo:400:kworker.0 00000100:00100000:2.0:1789575551.912593:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699348992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575551.912671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575551.913026:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699348992 00000100:00100000:3.0:1789575551.913038:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699348992 00000100:00100000:3.0:1789575551.913110:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789575551.913121:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699348992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575551.913177:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575551.913246:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699348992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575551.913254:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789575551.913534:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699348992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575551.976653:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575552.591126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575552.591240:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241664 00000100:00100000:2.0:1789575552.591261:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241664 00000100:00100000:2.0:1789575552.591323:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 259 00000100:00100000:2.0:1789575552.591333:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+11:5601:x1876505676241664:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575552.591352:0:5857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575552.591408:0:5857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef9200/0xc45cc82a2238336c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59ec expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575552.591441:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef9200/0xc45cc82a2238336c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ec expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575552.591452:0:5857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef9200/0xc45cc82a2238336c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ec expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575552.591461:0:5857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9200, rc 0) 00000100:00100000:2.0:1789575552.591523:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676241664:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 191us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575552.591530:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 259 00000100:00100000:3.0:1789575552.598516:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575552.598714:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241792 00000100:00100000:0.0:1789575552.598726:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241792 00000100:00100000:0.0:1789575552.598791:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 260 00000100:00100000:0.0:1789575552.598801:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676241792:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.599113:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676241792:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 311us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575552.599120:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 260 00000100:00100000:0.0:1789575552.604759:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575552.604946:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676241920 00000100:00100000:3.0:1789575552.604958:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676241920 00000100:00100000:3.0:1789575552.605019:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:3.0:1789575552.605028:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676241920:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.605519:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676241920:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 490us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.605528:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:1.0:1789575552.624600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575552.625175:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242048 00000100:00100000:2.0:1789575552.625187:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242048 00000100:00100000:2.0:1789575552.625268:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 262 00000100:00100000:2.0:1789575552.625280:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:9974:x1876505676242048:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789575552.625576:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+12:9974:x1876505676242048:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 297us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575552.625591:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 262 00000100:00100000:1.0:1789575552.634049:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575552.634408:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242176 00000100:00100000:3.0:1789575552.634420:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242176 00000100:00100000:3.0:1789575552.634487:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 263 00000100:00100000:3.0:1789575552.634497:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:9974:x1876505676242176:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789575552.634780:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+12:9974:x1876505676242176:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 283us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.634788:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 263 00000100:00100000:3.0:1789575552.644700:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575552.644809:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242304 00000100:00100000:0.0:1789575552.644819:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242304 00000100:00100000:0.0:1789575552.644886:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 264 00000100:00100000:0.0:1789575552.644898:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+12:5601:x1876505676242304:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575552.644919:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575552.644939:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2157200/0xc45cc82a22383373 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59f3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.644971:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2157200/0xc45cc82a22383373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59f3 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.644995:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2157200/0xc45cc82a22383373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59f3 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.645018:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2157200, rc 0) 00000100:00100000:0.0:1789575552.645088:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676242304:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575552.645096:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 264 00000100:00100000:1.0:1789575552.651479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575552.651951:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242432 00000100:00100000:2.0:1789575552.651964:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242432 00000100:00100000:2.0:1789575552.652037:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 265 00000100:00100000:2.0:1789575552.652048:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676242432:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575552.652677:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676242432:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 628us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575552.652687:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 265 00000100:00100000:1.0:1789575552.661351:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575552.661566:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242560 00000100:00100000:3.0:1789575552.661576:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242560 00000100:00100000:3.0:1789575552.661633:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 266 00000100:00100000:3.0:1789575552.661643:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676242560:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.661881:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:5601:x1876505676242560:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 239us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.661889:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 266 00000100:00100000:0.0:1789575552.668824:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575552.669626:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242688 00000100:00100000:3.0:1789575552.669639:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242688 00000100:00100000:3.0:1789575552.669714:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 267 00000100:00100000:3.0:1789575552.669726:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:9977:x1876505676242688:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789575552.670032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:9977:x1876505676242688:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 306us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.670051:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 267 00000100:00100000:1.0:1789575552.680310:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575552.680547:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242816 00000100:00100000:2.0:1789575552.680559:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242816 00000100:00100000:2.0:1789575552.680614:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 268 00000100:00100000:2.0:1789575552.680624:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:9977:x1876505676242816:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789575552.681014:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:9977:x1876505676242816:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 391us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575552.681023:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 268 10000000:01000000:1.0:1789575552.872482:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789575552.872491:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e95850a0800 from 7 10000000:01000000:1.0:1789575552.872496:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789575552.872718:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.872732:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.872756:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575552.872787:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789575552.872931:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575552.872986:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96865349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575552.873048:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349120 00000100:00100000:0.0:1789575552.873056:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349120 00000100:00100000:0.0:1789575552.873139:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789575552.873150:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+16:5859:x1876505699349120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575552.873166:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575552.873190:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2156000/0xc45cc82a22383381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238337a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.873221:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2156000/0xc45cc82a22383381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238337a expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.873233:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2156000/0xc45cc82a22383381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238337a expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.873242:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156000, rc 0) 00000100:00100000:0.0:1789575552.873297:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575552.873304:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789575552.873339:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575552.873353:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.873362:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575552.873463:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575552.873504:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575552.884500:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96865349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.884516:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349248 00000100:00100000:3.0:1789575552.884527:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349248 00000100:00100000:3.0:1789575552.884582:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789575552.885822:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.886124:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (12617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.886132:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789575552.886312:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575552.886361:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575552.886442:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575552.886479:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96865349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575552.886495:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349376 00000100:00100000:1.0:1789575552.886500:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349376 00000100:00100000:1.0:1789575552.886526:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789575552.886532:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575552.886684:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575552.886890:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789575552.886930:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.889806:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11709:1876505699349504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575552.889895:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575552.889983:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9687953e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575552.892308:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349504 00000100:00100000:2.0:1789575552.892323:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349504 00000100:00100000:1.0:1789575552.898010:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789575552.898041:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:11709:x1876505699349504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575552.904700:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:11709:x1876505699349504:12345-0@lo:502:llog_process_th.0 Request processed in 6665us (14794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575552.904715:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789575552.905071:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11709:1876505699349504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575552.905107:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575552.905118:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575552.905120:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789575552.905128:0:11709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e95850a0800 00000020:00000080:3.0:1789575552.905131:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789575552.905232:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11709:1876505699349632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575552.905283:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575552.905320:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9687953e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789575552.909672:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349632 00000100:00100000:1.0:1789575552.909689:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349632 00000100:00100000:1.0:1789575552.909749:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789575552.909759:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:11709:x1876505699349632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575552.910037:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+17:11709:x1876505699349632:12345-0@lo:502:llog_process_th.0 Request processed in 279us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575552.910051:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789575552.917215:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11709:1876505699349632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789575552.917271:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575552.917283:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575552.917286:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789575552.917292:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789575552.923023:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789575552.923069:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789575552.923083:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.923097:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575552.923298:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575552.923303:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9683db2800 from 7 10000000:01000000:0.0:1789575552.923306:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575552.923348:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.923401:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.923414:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575552.923443:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.923511:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.923560:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.923629:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349760 00000100:00100000:3.0:1789575552.923639:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349760 00000100:00100000:3.0:1789575552.923691:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789575552.923700:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+17:5859:x1876505699349760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575552.923713:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575552.923725:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e95850f0800/0xc45cc82a2238338f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383388 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.923749:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e95850f0800/0xc45cc82a2238338f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383388 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.923761:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e95850f0800/0xc45cc82a2238338f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383388 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.923770:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0800, rc 0) 00000100:00100000:3.0:1789575552.923806:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699349760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.923812:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789575552.923887:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575552.923901:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.923910:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575552.923959:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.923985:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.924016:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.924061:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699349888 00000100:00100000:3.0:1789575552.924065:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699349888 00000100:00100000:3.0:1789575552.924094:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789575552.924101:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699349888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.924357:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699349888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.924364:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789575552.924464:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699349888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.924493:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.924531:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.924559:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.924602:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350016 00000100:00100000:3.0:1789575552.924606:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350016 00000100:00100000:3.0:1789575552.924632:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789575552.924639:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699350016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.924779:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699350016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.924786:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789575552.924854:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.925766:0:11712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11712:1876505699350144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575552.925838:0:11712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.925876:0:11712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.925921:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350144 00000100:00100000:3.0:1789575552.925929:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350144 00000100:00100000:3.0:1789575552.925970:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789575552.925978:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:11712:x1876505699350144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575552.926178:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+18:11712:x1876505699350144:12345-0@lo:502:llog_process_th.0 Request processed in 200us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.926186:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789575552.926275:0:11712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11712:1876505699350144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575552.926300:0:11712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575552.926309:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575552.926311:0:11712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789575552.926317:0:11712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9683db2800 00000020:00000080:1.0:1789575552.926320:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789575552.926432:0:11712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11712:1876505699350272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575552.926462:0:11712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575552.926482:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350272 00000100:00100000:1.0:1789575552.926486:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350272 00000100:00100000:1.0:1789575552.926506:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789575552.926511:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:11712:x1876505699350272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575552.926616:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:11712:x1876505699350272:12345-0@lo:502:llog_process_th.0 Request processed in 104us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575552.926622:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789575552.926650:0:11712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686534300 going to sleep for 11 seconds 00000100:00100000:1.0:1789575552.926662:0:11712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11712:1876505699350272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575552.926687:0:11712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575552.926691:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575552.926693:0:11712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789575552.926696:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789575552.928825:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789575552.928861:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575552.928873:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.928886:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575552.928897:0:5859:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789575552.928899:0:5859:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9689726000 from 7 10000000:01000000:3.0:1789575552.928902:0:5859:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575552.928940:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.928949:0:5859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.928960:0:5859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575552.928996:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.929059:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575552.929102:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9687953780 going to sleep for 11 seconds 00000100:00100000:1.0:1789575552.931069:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350400 00000100:00100000:1.0:1789575552.931089:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350400 00000100:00100000:1.0:1789575552.931168:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789575552.931179:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+18:5859:x1876505699350400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575552.931197:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575552.931215:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238339d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22383396 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.931244:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238339d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22383396 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.931255:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238339d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22383396 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575552.931264:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1000, rc 0) 00000100:00100000:1.0:1789575552.931342:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699350400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575552.931348:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789575552.934609:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575552.934642:0:5859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575552.934656:0:5859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575552.934748:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.934811:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.934858:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789575552.934942:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350528 00000100:00100000:2.0:1789575552.934950:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350528 00000100:00100000:2.0:1789575552.934989:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789575552.934997:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699350528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575552.935233:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699350528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575552.935240:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789575552.935323:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.935353:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.935427:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.935447:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.935592:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350656 00000100:00100000:3.0:1789575552.935598:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350656 00000100:00100000:3.0:1789575552.935631:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789575552.935639:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699350656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575552.935785:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:5859:x1876505699350656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.935792:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000040:00080000:3.0:1789575552.936351:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789575552.939051:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:30b00971-c2a0-490d-912f-6313f32cd11c:5859:1876505699350656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575552.949341:0:11715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11715:1876505699350784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575552.949457:0:11715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.949501:0:11715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.949644:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350784 00000100:00100000:3.0:1789575552.949653:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350784 00000100:00100000:3.0:1789575552.949703:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789575552.949712:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:11715:x1876505699350784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575552.949933:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:11715:x1876505699350784:12345-0@lo:502:llog_process_th.0 Request processed in 221us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.949941:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789575552.950113:0:11715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11715:1876505699350784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789575552.950143:0:11715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575552.950153:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575552.950156:0:11715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789575552.950163:0:11715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9689726000 00000020:00000080:0.0:1789575552.950174:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789575552.950260:0:11715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11715:1876505699350912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575552.950293:0:11715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575552.950324:0:11715:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b06acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575552.950693:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699350912 00000100:00100000:3.0:1789575552.950700:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699350912 00000100:00100000:3.0:1789575552.950733:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789575552.950740:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:11715:x1876505699350912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789575552.950897:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:11715:x1876505699350912:12345-0@lo:502:llog_process_th.0 Request processed in 157us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575552.950905:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789575552.950981:0:11715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:30b00971-c2a0-490d-912f-6313f32cd11c:11715:1876505699350912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575552.951003:0:11715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575552.951009:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575552.951011:0:11715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789575552.951015:0:11715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789575552.953747:0:5859:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789575552.953785:0:5859:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575552.953797:0:5859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575552.953811:0:5859:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575553.000707:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789575553.965235:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789575554.035715:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575555.048715:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575555.213746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575555.213805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575555.213980:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243072 00000100:00100000:3.0:1789575555.213994:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243072 00000100:00100000:3.0:1789575555.214075:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243328 00000100:00100000:3.0:1789575555.214078:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243328 00000100:00100000:3.0:1789575555.214105:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:3.0:1789575555.214116:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676243072:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575555.214238:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:2.0:1789575555.214248:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676243328:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:0.0:1789575555.214318:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575555.215148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575555.215185:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676243072:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1069us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575555.215195:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:3.0:1789575555.215240:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676242944 00000100:00100000:3.0:1789575555.215247:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676242944 00000100:00100000:3.0:1789575555.215292:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:3.0:1789575555.215300:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676242944:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575555.219779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575555.219883:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243200 00000100:00100000:1.0:1789575555.219895:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243200 00000100:00100000:1.0:1789575555.219974:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:1.0:1789575555.219985:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676243200:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575555.220057:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676243200:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575555.220065:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:2.0:1789575555.220207:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676243328:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 5959us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575555.220217:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00080000:2.0:1789575555.220335:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575555.220768:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676242944:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 5462us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575555.220779:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:3.0:1789575555.496754:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699351040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575555.496852:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575555.497124:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351040 00000100:00100000:2.0:1789575555.497134:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351040 00000100:00100000:2.0:1789575555.497246:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789575555.497264:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699351040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575555.497305:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575555.497435:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699351040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575555.497442:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789575555.497674:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b4000 x1876505699351040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575555.497698:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699351040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575555.502690:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575556.072612:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575556.521218:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699351424:0@lo:400:kworker.0 00000100:00100000:3.0:1789575556.521223:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699351168:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.526467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575556.526572:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789575556.526586:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699351296:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.526621:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575556.526651:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699351808:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.526677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575556.526725:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351808 00000100:00100000:2.0:1789575556.526734:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351808 00000100:00100000:2.0:1789575556.526798:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789575556.526808:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.526870:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699351808:12345-0@lo:400:kworker.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575556.526893:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789575556.526931:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575556.526968:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699351808:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.527009:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351424 00000100:00100000:2.0:1789575556.527014:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351424 00000100:00100000:2.0:1789575556.527045:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351296 00000100:00100000:2.0:1789575556.527048:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351296 00000100:00100000:2.0:1789575556.527070:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789575556.527076:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699351424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.527115:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699351424:12345-0@lo:400:kworker.0 Request processed in 39us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575556.527121:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789575556.527132:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789575556.527137:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699351296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.527162:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699351296:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575556.527168:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789575556.527183:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575556.527202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699351296:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.527214:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699351424:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.532189:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699351552:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.532290:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575556.532425:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351552 00000100:00100000:2.0:1789575556.532506:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351552 00000100:00100000:2.0:1789575556.532569:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789575556.532598:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699351552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.532667:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699351552:12345-0@lo:400:kworker.0 Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575556.532675:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789575556.532702:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc404000 x1876505699351552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575556.532718:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699351552:0@lo:400:kworker.0 00000100:00100000:3.0:1789575556.532974:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575556.533017:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699351680:0@lo:400:kworker.0 00000100:00100000:3.0:1789575556.533044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575556.533197:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351168 00000100:00100000:0.0:1789575556.533204:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351168 00000100:00100000:0.0:1789575556.533243:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789575556.533251:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699351168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575556.533305:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699351168:12345-0@lo:400:kworker.0 Request processed in 54us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575556.533312:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789575556.533492:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699351168:0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.533543:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351680 00000100:00100000:2.0:1789575556.533549:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351680 00000100:00100000:2.0:1789575556.533673:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789575556.533681:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699351680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575556.533729:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699351680:12345-0@lo:400:kworker.0 Request processed in 50us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575556.533736:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789575556.533791:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699351680:0@lo:400:kworker.0 00000100:00080000:0.0:1789575556.533899:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575557.033582:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699351936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575557.033674:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575557.033869:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699351936 00000100:00100000:3.0:1789575557.033879:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699351936 00000100:00100000:3.0:1789575557.033957:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789575557.033967:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699351936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575557.034007:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575557.034065:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699351936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575557.034072:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789575557.034340:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699351936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575557.096674:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575558.126926:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575559.146497:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575560.170618:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575560.332122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575560.332174:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575560.332219:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575560.332261:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575560.332307:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243712 00000100:00100000:0.0:1789575560.332320:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243712 00000100:00100000:0.0:1789575560.332439:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:0.0:1789575560.332452:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676243712:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575560.332551:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676243712:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575560.332578:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00080000:0.0:1789575560.332604:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575560.332867:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243456 00000100:00100000:1.0:1789575560.332873:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243456 00000100:00100000:1.0:1789575560.332910:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 286 00000100:00100000:1.0:1789575560.332918:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676243456:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575560.332983:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243584 00000100:00100000:2.0:1789575560.332988:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243584 00000100:00100000:2.0:1789575560.333022:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243840 00000100:00100000:2.0:1789575560.333025:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243840 00000100:00100000:2.0:1789575560.333048:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:2.0:1789575560.333055:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676243584:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:0.0:1789575560.333105:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575560.333132:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:3.0:1789575560.333146:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676243840:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575560.335997:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676243456:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 3064us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575560.336015:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 286 00000100:00100000:2.0:1789575560.337831:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676243584:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 4763us (5710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575560.337847:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:3.0:1789575560.338507:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676243840:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 5359us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575560.338520:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:0.0:1789575560.616878:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699352064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575560.616961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575560.617058:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352064 00000100:00100000:3.0:1789575560.617094:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352064 00000100:00100000:3.0:1789575560.617188:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789575560.617199:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699352064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575560.617239:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575560.617314:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699352064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575560.617321:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789575560.617398:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b4000 x1876505699352064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575560.617421:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699352064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575560.617507:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575561.193766:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575561.641810:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699352192:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.641884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575561.641927:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699352704:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.641954:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575561.641984:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575561.641989:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699352576:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.642014:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575561.642040:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352192 00000100:00100000:3.0:1789575561.642043:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699352320:0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642050:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352192 00000100:00100000:3.0:1789575561.642067:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575561.642083:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699352832:0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642097:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789575561.642100:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575561.642106:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699352192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.642115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575561.642120:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699352448:0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642158:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699352192:12345-0@lo:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575561.642165:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789575561.642674:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352576 00000100:00100000:0.0:1789575561.642681:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352576 00000100:00100000:0.0:1789575561.642713:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352832 00000100:00100000:0.0:1789575561.642716:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352832 00000100:00100000:0.0:1789575561.642747:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789575561.642754:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699352576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642797:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699352576:12345-0@lo:400:kworker.0 Request processed in 44us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575561.642804:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789575561.642817:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789575561.642823:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699352832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642854:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699352832:12345-0@lo:400:kworker.0 Request processed in 31us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575561.642876:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789575561.642897:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352704 00000100:00100000:0.0:1789575561.642901:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352704 00000100:00100000:0.0:1789575561.642926:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352320 00000100:00100000:0.0:1789575561.642930:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352320 00000100:00100000:0.0:1789575561.642948:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789575561.642954:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699352704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.642985:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699352704:12345-0@lo:400:kworker.0 Request processed in 31us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575561.642990:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789575561.643001:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789575561.643006:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699352320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575561.643048:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699352320:12345-0@lo:400:kworker.0 Request processed in 42us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575561.643054:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789575561.643085:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789575561.643090:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575561.643121:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575561.643620:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699352320:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.643632:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699352832:0@lo:400:kworker.0 00010000:00080000:3.0:1789575561.643666:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc407100 x1876505699352576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575561.643685:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699352576:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.643697:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699352192:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.643706:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699352704:0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.643728:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352448 00000100:00100000:3.0:1789575561.643732:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352448 00000100:00080000:0.0:1789575561.643798:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575561.644089:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789575561.644099:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699352448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575561.644303:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699352448:12345-0@lo:400:kworker.0 Request processed in 205us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575561.644310:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789575561.644328:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699352448:0@lo:400:kworker.0 00000100:00100000:0.0:1789575562.153636:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699352960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575562.153733:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575562.153948:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699352960 00000100:00100000:2.0:1789575562.153958:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699352960 00000100:00100000:2.0:1789575562.154024:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789575562.154035:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699352960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575562.154075:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575562.154155:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699352960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575562.154162:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789575562.154213:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699352960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575562.217697:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789575563.177244:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789575563.241043:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575564.264729:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575565.290114:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575565.460785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575565.460870:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575565.461039:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676243968 00000100:00100000:1.0:1789575565.461051:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676243968 00000100:00100000:1.0:1789575565.461118:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 288 00000100:00100000:1.0:1789575565.461128:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676243968:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575565.461235:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676243968:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575565.461243:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 288 00000100:00100000:2.0:1789575565.461889:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244096 00000100:00100000:2.0:1789575565.461897:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244096 00000100:00100000:2.0:1789575565.461965:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:2.0:1789575565.461977:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676244096:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575565.462028:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676244096:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 55us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575565.462034:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00080000:1.0:1789575565.462396:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575565.472748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575565.472816:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575565.472974:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244352 00000100:00100000:2.0:1789575565.472988:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244352 00000100:00100000:2.0:1789575565.473091:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:2.0:1789575565.473102:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676244352:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575565.473203:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676244352:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 103us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575565.473211:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:1.0:1789575565.474064:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244224 00000100:00100000:1.0:1789575565.474083:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244224 00000100:00100000:1.0:1789575565.474146:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789575565.474155:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2354:x1876505676244224:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789575565.474183:0:6709:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223832d9 00000100:00080000:1.0:1789575565.474195:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8e96878e4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789575565.474249:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789575565.475128:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575565.475323:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+2:2354:x1876505676244224:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 1163us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575565.475344:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00080000:0.0:1789575565.476197:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575565.476228:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575565.737048:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699353088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575565.737140:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575565.737653:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353088 00000100:00100000:2.0:1789575565.737663:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353088 00000100:00100000:2.0:1789575565.737776:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789575565.737786:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699353088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575565.737834:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575565.737907:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699353088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575565.737914:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789575565.738081:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789575565.738167:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b4000 x1876505699353088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575565.738191:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699353088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575566.312840:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575566.763727:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699353472:0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.763796:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575566.763857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789575566.763863:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699353344:0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.763883:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575566.763915:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699353856:0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.763952:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575566.763989:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353472 00000100:00100000:3.0:1789575566.763998:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353472 00000100:00100000:3.0:1789575566.764044:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353344 00000100:00100000:3.0:1789575566.764046:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353344 00000100:00100000:3.0:1789575566.764064:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789575566.764071:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699353472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.764113:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699353472:12345-0@lo:400:kworker.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575566.764120:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789575566.764135:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789575566.764140:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699353344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.764160:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699353344:12345-0@lo:400:kworker.0 Request processed in 20us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575566.764165:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789575566.764199:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699353344:0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.764208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699353472:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699353216:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575566.764430:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699353728:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575566.764467:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575566.764472:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699353600:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575566.764513:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353856 00000100:00100000:0.0:1789575566.764516:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353856 00000100:00100000:0.0:1789575566.764540:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353600 00000100:00100000:0.0:1789575566.764542:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353600 00000100:00100000:0.0:1789575566.764558:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789575566.764564:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764594:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699353856:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575566.764600:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789575566.764611:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789575566.764616:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699353600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764638:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699353600:12345-0@lo:400:kworker.0 Request processed in 23us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575566.764644:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789575566.764656:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575566.764660:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575566.764694:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353728 00000100:00100000:0.0:1789575566.764697:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353728 00000100:00100000:0.0:1789575566.764717:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789575566.764730:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699353728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764754:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699353728:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575566.764759:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789575566.764769:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789575566.764787:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc407100 x1876505699353600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575566.764798:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699353600:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.764806:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699353728:0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.764982:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353216 00000100:00100000:3.0:1789575566.764986:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353216 00000100:00100000:3.0:1789575566.765017:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789575566.765023:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699353216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575566.765058:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699353216:12345-0@lo:400:kworker.0 Request processed in 36us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575566.765064:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789575566.765099:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699353856:0@lo:400:kworker.0 00000100:00100000:0.0:1789575566.765161:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699353216:0@lo:400:kworker.0 00000100:00100000:2.0:1789575567.273336:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789575567.273393:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699353984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575567.273491:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575567.273813:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699353984 00000100:00100000:3.0:1789575567.273821:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699353984 00000100:00100000:3.0:1789575567.273876:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789575567.273885:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699353984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575567.273919:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575567.273965:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699353984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575567.273971:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789575567.274354:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699353984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575567.343197:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575568.360759:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575569.388753:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789575569.905547:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:0.0:1789575569.905559:0:7664:0:(genops.c:885:class_export_put()) final put ffff8e96878e1800/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:1.0:1789575569.905639:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96878e1800/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-OST0001 00000020:00000080:1.0:1789575569.905691:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96878e4000 for lustre-OST0001 00010000:00010000:3.0:1789575570.408882:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575570.572043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575570.572154:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575570.572281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575570.572642:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244480 00000100:00100000:1.0:1789575570.572672:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244480 00000100:00100000:1.0:1789575570.573108:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 290 00000100:00100000:1.0:1789575570.573122:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676244480:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575570.573241:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676244480:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 121us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575570.573342:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 290 00000100:00100000:2.0:1789575570.578971:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244608 00000100:00100000:2.0:1789575570.578992:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244608 00000100:00100000:2.0:1789575570.579138:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244736 00000100:00100000:2.0:1789575570.579142:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244736 00000100:00100000:3.0:1789575570.579223:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00100000:3.0:1789575570.579237:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676244608:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575570.579395:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2355:x1876505676244608:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 126us (7205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575570.579408:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00080000:1.0:1789575570.583447:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575570.584158:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:2.0:1789575570.584176:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676244736:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575570.584300:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676244736:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 129us (12019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575570.584308:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:1.0:1789575570.858872:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699354112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575570.858951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575570.859670:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354112 00000100:00100000:2.0:1789575570.859695:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354112 00000100:00100000:2.0:1789575570.859784:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789575570.859795:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699354112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575570.859849:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575570.859922:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699354112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575570.859929:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789575570.863578:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b7b80 x1876505699354112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575570.863608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699354112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575570.863650:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789575571.435100:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575571.881692:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699354240:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.881775:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575571.881821:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354240 00000100:00100000:1.0:1789575571.881832:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354240 00000100:00100000:3.0:1789575571.881835:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699354752:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.881868:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575571.881898:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575571.881899:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789575571.881912:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699354240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.881923:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699354624:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.881959:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575571.881978:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699354240:12345-0@lo:400:kworker.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575571.881987:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789575571.882003:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699354240:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.882037:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699354368:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.882061:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575571.882084:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699354880:0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.882101:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354752 00000100:00100000:1.0:1789575571.882108:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354752 00000100:00100000:3.0:1789575571.882109:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575571.882134:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575571.882142:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699354496:0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.882155:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354368 00000100:00100000:1.0:1789575571.882160:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354368 00000100:00100000:3.0:1789575571.882169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575571.882339:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354496 00000100:00100000:1.0:1789575571.882344:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354496 00000100:00100000:3.0:1789575571.882401:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789575571.882412:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699354752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.882453:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789575571.882458:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699354752:12345-0@lo:400:kworker.0 Request processed in 49us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575571.882465:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699354368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.882471:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789575571.882490:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789575571.882499:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699354496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.882530:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699354368:12345-0@lo:400:kworker.0 Request processed in 68us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575571.882537:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1789575571.882566:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575571.883451:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354624 00000100:00100000:1.0:1789575571.883459:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354624 00000100:00100000:1.0:1789575571.883502:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699354880 00000100:00100000:1.0:1789575571.883505:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699354880 00000100:00100000:1.0:1789575571.883553:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789575571.883563:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699354624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.883820:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699354496:12345-0@lo:400:kworker.0 Request processed in 1321us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575571.883822:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699354624:12345-0@lo:400:kworker.0 Request processed in 261us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575571.883838:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789575571.883838:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789575571.883864:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789575571.883873:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699354880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.883901:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699354496:0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.883913:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699354880:12345-0@lo:400:kworker.0 Request processed in 41us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575571.883922:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699354368:0@lo:400:kworker.0 00000100:00100000:1.0:1789575571.883923:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789575571.883942:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699354880:0@lo:400:kworker.0 00000100:00080000:1.0:1789575571.883954:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789575571.883995:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bd2e9f80 x1876505699354624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575571.884006:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699354624:0@lo:400:kworker.0 00000100:00100000:3.0:1789575571.884018:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699354752:0@lo:400:kworker.0 00000100:00100000:3.0:1789575572.393053:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575572.393082:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699355008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575572.393157:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575572.393251:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355008 00000100:00100000:3.0:1789575572.393260:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355008 00000100:00100000:3.0:1789575572.393316:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789575572.393326:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699355008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575572.393366:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575572.393447:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699355008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575572.393454:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789575572.393508:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699355008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789575572.480428:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789575573.422365:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789575573.483720:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575574.506720:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575575.528828:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575575.697336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575575.697418:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575575.697452:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575575.697497:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244992 00000100:00100000:1.0:1789575575.697510:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244992 00000100:00100000:1.0:1789575575.697590:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245120 00000100:00100000:1.0:1789575575.697592:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245120 00000100:00100000:1.0:1789575575.697625:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:1.0:1789575575.697645:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676244992:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575575.697759:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676244992:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575575.697777:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:2.0:1789575575.697794:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676244864 00000100:00100000:2.0:1789575575.697799:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676244864 00000100:00100000:1.0:1789575575.697802:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:1.0:1789575575.697809:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676245120:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575575.697836:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676245120:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575575.697839:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00100000:1.0:1789575575.697842:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:2.0:1789575575.697847:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676244864:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:1.0:1789575575.697858:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575575.697872:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676244864:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575575.697878:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00100000:3.0:1789575575.976594:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699355136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575575.976708:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575575.977014:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355136 00000100:00100000:1.0:1789575575.977025:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355136 00000100:00100000:1.0:1789575575.977111:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789575575.977124:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699355136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575575.977185:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575575.977244:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699355136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575575.977252:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1789575575.977320:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bd1da300 x1876505699355136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575575.977345:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699355136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789575575.977743:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789575576.193008:0:11879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:19:34 (1789575574) 00010000:00010000:1.0:1789575576.552605:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575577.001270:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699355520:0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.001484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575577.001611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789575577.001639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699355392:0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.001685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575577.001725:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699355904:0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.001758:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575577.001795:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355520 00000100:00100000:0.0:1789575577.001803:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355520 00000100:00100000:0.0:1789575577.001893:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355392 00000100:00100000:0.0:1789575577.001926:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355392 00000100:00100000:0.0:1789575577.001986:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789575577.002003:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699355520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.002110:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699355520:12345-0@lo:400:kworker.0 Request processed in 110us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575577.002123:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789575577.002169:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789575577.002184:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699355392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.002227:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699355392:12345-0@lo:400:kworker.0 Request processed in 50us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575577.002233:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789575577.002276:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699355392:0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.002286:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699355520:0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.006618:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699355264:0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.006801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575577.006891:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699355776:0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.006921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575577.006976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575577.006985:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699355648:0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.007009:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789575577.007042:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575577.007071:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355776 00000100:00100000:3.0:1789575577.007084:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355776 00000100:00100000:3.0:1789575577.007200:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789575577.007212:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699355776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.007296:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699355776:12345-0@lo:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575577.007308:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1789575577.007340:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575577.007466:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699355776:0@lo:400:kworker.0 00000100:00100000:1.0:1789575577.008112:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355904 00000100:00100000:1.0:1789575577.008120:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355904 00000100:00100000:1.0:1789575577.008185:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355648 00000100:00100000:1.0:1789575577.008188:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355648 00000100:00100000:1.0:1789575577.008210:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789575577.008217:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699355904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575577.008294:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699355904:12345-0@lo:400:kworker.0 Request processed in 77us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575577.008301:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789575577.008315:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789575577.008321:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699355648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575577.008355:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699355648:12345-0@lo:400:kworker.0 Request processed in 34us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575577.008360:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789575577.008845:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575577.008857:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789575577.009094:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bc398e00 x1876505699355648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789575593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575577.009121:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699355648:0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.009591:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699355264 00000100:00100000:0.0:1789575577.009598:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699355264 00000100:00100000:0.0:1789575577.009665:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789575577.009674:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699355264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575577.009750:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699355264:12345-0@lo:400:kworker.0 Request processed in 77us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575577.009757:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789575577.009816:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699355904:0@lo:400:kworker.0 00000100:00100000:3.0:1789575577.010064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699355264:0@lo:400:kworker.0 00000100:00100000:2.0:1789575577.517458:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789575577.517499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699356032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575577.517609:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575577.517689:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356032 00000100:00100000:1.0:1789575577.517700:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356032 00000100:00100000:1.0:1789575577.517758:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789575577.517768:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb6cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699356032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575577.517812:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575577.517874:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb6cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699356032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575577.517880:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789575577.518326:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699356032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575577.578046:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575578.605093:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575578.784644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575578.784913:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245248 00000100:00100000:0.0:1789575578.784930:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245248 00000100:00100000:0.0:1789575578.785032:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789575578.785053:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:10247:x1876505676245248:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575578.785105:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575578.785148:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223833a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae59fa expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785235:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785252:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785269:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575578.785333:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575578.785337:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575578.785420:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785608:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223833a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59fa expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785634:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59fa expref: 6 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575578.785643:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575578.785646:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575578.785651:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156400, rc 0) 00000100:00100000:0.0:1789575578.785748:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:10247:x1876505676245248:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 705us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575578.785767:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00080000:2.0:1789575578.786534:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575578.803691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575578.804088:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245376 00000100:00100000:2.0:1789575578.804109:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245376 00000100:00100000:2.0:1789575578.804206:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789575578.804221:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:10248:x1876505676245376:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575578.804252:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575578.804295:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223833b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a01 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804420:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804436:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804474:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804492:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804499:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804505:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804768:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804777:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804785:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575578.804827:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575578.804833:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575578.804866:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804880:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804887:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804904:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804911:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575578.804916:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804924:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804937:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:2.0:1789575578.804940:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575578.804948:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804953:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804967:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804972:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804977:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804982:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575578.804984:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.804998:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.805006:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e9683773b00) 00010000:00010000:2.0:1789575578.805008:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575578.805011:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.805017:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.805047:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223833b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a01 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.805062:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a01 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.805068:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9683773600) 00010000:00010000:2.0:1789575578.805070:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575578.805073:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9a00, rc 0) 00000100:00100000:2.0:1789575578.805191:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:10248:x1876505676245376:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 973us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575578.805200:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789575578.828063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575578.828205:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245632 00000100:00100000:2.0:1789575578.828218:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245632 00000100:00100000:2.0:1789575578.828302:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789575578.828315:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:10248:x1876505676245632:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575578.828410:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575578.828437:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223833ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a08 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828531:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828554:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828569:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828603:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828611:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.828619:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829071:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223833e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829080:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223833e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829088:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223833e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575578.829100:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789575578.829330:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829338:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829345:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829353:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575578.829358:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829366:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829417:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9683773600) 00010000:00010000:2.0:1789575578.829420:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575578.829425:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829433:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a223833d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829447:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829453:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829458:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829474:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575578.829477:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829483:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829491:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e9683773b00) 00010000:00010000:2.0:1789575578.829494:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575578.829497:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.829503:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223833dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.830046:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223833ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a08 expref: 10 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.830067:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223833e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a08 expref: 9 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575578.830074:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575578.830078:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575578.830080:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8000, rc 0) 00000100:00100000:2.0:1789575578.830206:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10248:x1876505676245632:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1892us (2156us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789575578.830216:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:0.0:1789575578.836765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575578.838165:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245760 00000100:00100000:3.0:1789575578.838192:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245760 00000100:00100000:3.0:1789575578.838307:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789575578.838324:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10248:x1876505676245760:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789575578.838608:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10248:x1876505676245760:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 288us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575578.838654:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000040:00080000:3.0:1789575579.568973:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789575579.645471:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789575579.653652:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1789575580.649998:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575580.816027:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575580.816094:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575580.816168:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575580.816215:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246144 00000100:00100000:1.0:1789575580.816232:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246144 00000100:00100000:1.0:1789575580.816334:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246016 00000100:00100000:1.0:1789575580.816338:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246016 00000100:00100000:1.0:1789575580.816411:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:1.0:1789575580.816427:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676246144:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575580.816599:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676246144:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 164us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575580.816608:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:1.0:1789575580.816633:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00100000:1.0:1789575580.816640:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676246016:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575580.816667:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676246016:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575580.816675:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00080000:1.0:1789575580.816699:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575580.819444:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676245888 00000100:00100000:3.0:1789575580.819481:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676245888 00000100:00100000:3.0:1789575580.819746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:3.0:1789575580.819761:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676245888:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575580.819879:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676245888:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 122us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575580.819888:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:1.0:1789575581.097904:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699356160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575581.098298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575581.098866:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356160 00000100:00100000:3.0:1789575581.098886:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356160 00000100:00100000:3.0:1789575581.098998:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575581.099013:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699356160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575581.099073:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575581.099185:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699356160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575581.099194:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789575581.099349:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789575581.100424:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bb5b7800 x1876505699356160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575581.100459:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699356160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575581.618063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575581.618160:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246272 00000100:00100000:0.0:1789575581.618175:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246272 00000100:00100000:0.0:1789575581.618252:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:0.0:1789575581.618264:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10290:x1876505676246272:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575581.618297:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575581.618329:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223833f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a0f expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618480:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618501:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618520:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618538:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618545:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618552:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.618782:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619033:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619040:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619046:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575581.619051:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619059:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619072:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575581.619075:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575581.619081:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619087:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223833f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619112:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619119:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619125:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619129:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575581.619140:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619147:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619155:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e9687dc9400) 00010000:00010000:0.0:1789575581.619158:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575581.619161:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619172:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223833ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619217:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223833f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a0f expref: 9 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619228:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575581.619230:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575581.619234:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223833f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a0f expref: 9 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.619243:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156600, rc 0) 00000100:00100000:0.0:1789575581.619334:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10290:x1876505676246272:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1072us (1285us total) trans 0 rc 301/301 00000100:00100000:0.0:1789575581.619343:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789575581.629062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575581.630484:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246528 00000100:00100000:3.0:1789575581.630502:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246528 00000100:00100000:3.0:1789575581.630569:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:3.0:1789575581.630580:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10290:x1876505676246528:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:3.0:1789575581.630664:0:5864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575581.630699:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223833ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59fa expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.630717:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:3.0:1789575581.630738:0:5864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575581.631512:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.631530:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.631542:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.631557:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.631565:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.631571:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575581.635870:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789575581.635893:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.635906:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.635914:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.635921:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575581.635927:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.635948:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.636215:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:3.0:1789575581.636219:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575581.636225:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.636232:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383406 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575581.636254:0:5864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2b55b93 reply state 00000000aa560330 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575581.636263:0:5864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575581.636408:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10290:x1876505676246528:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 5825us (7358us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789575581.637400:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00010000:00010000:0.0:1789575581.645154:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645176:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645208:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645215:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575581.645221:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645231:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645256:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e9687bd8c00) 00010000:00010000:0.0:1789575581.645259:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575581.645265:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.645271:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238340d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.673888:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575581.781291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575581.783869:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246656 00000100:00100000:2.0:1789575581.783893:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246656 00000100:00100000:2.0:1789575581.783963:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789575581.783975:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10298:x1876505676246656:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:2.0:1789575581.784001:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575581.784029:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a16 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784111:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784126:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784138:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575581.784180:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575581.784183:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575581.784220:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784248:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a16 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784263:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a16 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.784289:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:2.0:1789575581.784293:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575581.784297:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9600, rc 0) 00000100:00100000:2.0:1789575581.784411:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10298:x1876505676246656:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 437us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575581.784419:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789575581.869057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575581.869222:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676246784 00000100:00100000:2.0:1789575581.869237:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676246784 00000100:00100000:2.0:1789575581.869364:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789575581.869463:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10304:x1876505676246784:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575581.869489:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575581.869514:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a1d expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869628:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869648:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869662:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869680:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869688:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869708:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869845:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869853:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869861:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575581.869892:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789575581.869896:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575581.869941:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869966:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869973:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869980:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869986:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575581.869990:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.869998:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870018:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:2.0:1789575581.870021:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575581.870027:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870033:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870049:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870056:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870071:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870077:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575581.870080:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870086:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870093:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e9683773a00) 00010000:00010000:2.0:1789575581.870096:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575581.870099:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870122:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383430 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870171:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a1d expref: 11 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870186:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a1d expref: 10 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575581.870194:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575581.870197:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789575581.870199:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8600, rc 0) 00000100:00100000:2.0:1789575581.870281:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+10:10304:x1876505676246784:12345-192.168.202.32@tcp:101:bash.0 Request processed in 821us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575581.870290:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789575581.876804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575581.876910:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247040 00000100:00100000:3.0:1789575581.876933:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247040 00000100:00100000:3.0:1789575581.877132:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789575581.877150:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:10304:x1876505676247040:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575581.877190:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575581.877226:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a2238343e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a24 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.877526:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.877587:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.877606:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.879575:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.879606:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.879622:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575581.881362:0:5864:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789575581.883111:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883149:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883170:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883430:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883439:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883447:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883474:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575581.883480:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883489:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883588:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575581.883593:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575581.883599:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883607:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383445 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575581.883626:0:5864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a46489f2 reply state 00000000a6d62697 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575581.883636:0:5864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789575581.883899:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a2238343e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 13 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.883920:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 12 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.884058:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575581.884061:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575581.884063:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575581.884268:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10304:x1876505676247040:12345-192.168.202.32@tcp:101:bash.0 Request processed in 7121us (7474us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789575581.884288:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00010000:00010000:1.0:1789575581.887559:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887586:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887595:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887626:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575581.887632:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887641:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887666:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687bd8600) 00010000:00010000:1.0:1789575581.887670:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575581.887676:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.887681:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238344c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575581.891522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575581.891624:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247168 00000100:00100000:3.0:1789575581.891645:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247168 00000100:00100000:3.0:1789575581.892040:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575581.892051:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1876505676247168:12345-192.168.202.32@tcp:8:bash.0 00010000:00080000:3.0:1789575581.892098:0:6708:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:3.0:1789575581.892159:0:6708:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a22383461 00002000:00100000:3.0:1789575581.892173:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 22a2b54c-4bca-4302-892e-490c3310b8b3/ffff8e96878e0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575581.892250:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575581.892647:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789575581.893087:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8e96878e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575581.893212:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676247168:12345-192.168.202.32@tcp:8:bash.0 Request processed in 1159us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575581.893221:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575581.895550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575581.895628:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247296 00000100:00100000:1.0:1789575581.895643:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247296 00000100:00080000:2.0:1789575581.895720:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789575581.895757:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789575581.895836:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:0:x1876505676247296:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789575581.895857:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575581.895884:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a2b expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789575581.895914:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789575581.895935:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1789575581.895940:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575581.895949:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.895992:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575581.896005:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1600, rc 0) 00000100:00100000:1.0:1789575581.896079:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:0:x1876505676247296:12345-192.168.202.32@tcp:101:bash.0 Request processed in 246us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575581.896087:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789575581.905541:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575581.905689:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247424 00000100:00100000:2.0:1789575581.905711:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247424 00000100:00100000:3.0:1789575581.905910:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:3.0:1789575581.905928:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:10304:x1876505676247424:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575581.905960:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575581.906090:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a32 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.906232:0:9232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.906272:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575581.906277:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575581.906285:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.906336:0:9232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.906355:0:9232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575581.906539:0:9232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9232:1876505699356288:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575581.906806:0:9232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575581.913610:0:9232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd2e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9232:1876505699356288:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575581.913664:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575581.913693:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1a00, rc 0) 00000100:00100000:3.0:1789575581.914569:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10304:x1876505676247424:12345-192.168.202.32@tcp:101:bash.0 Request processed in 8638us (9038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575581.914581:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789575581.914876:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575581.915599:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247552 00000100:00100000:0.0:1789575581.915612:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247552 00010000:00010000:0.0:1789575581.915656:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575581.915706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:0.0:1789575581.915716:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676247552:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575581.915743:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575581.915782:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.915818:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.915849:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383468 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a2b expref: 8 pid: 6709 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.915871:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789575581.915876:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575581.915887:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.915899:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575581.915945:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575581.915962:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1876505699356416:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789575581.916071:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575581.931083:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575581.931320:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1876505699356416:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789575581.931350:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575581.931469:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676247552:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 15753us (16593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575581.931482:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789575581.931613:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676247808 00000100:00100000:3.0:1789575581.931622:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676247808 00000100:00100000:3.0:1789575581.931682:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575581.931702:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+12:10304:x1876505676247808:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789575581.932456:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10304:x1876505676247808:12345-192.168.202.32@tcp:35:bash.0 Request processed in 754us (1398us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789575581.932464:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575582.071150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.071811:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676248064 00000100:00100000:0.0:1789575582.071830:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676248064 00000100:00100000:0.0:1789575582.071961:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789575582.071979:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10314:x1876505676248064:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575582.072018:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575582.072049:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383476 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a39 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575582.072207:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789575582.073071:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383476 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a39 expref: 15 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.073095:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:0.0:1789575582.073111:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575582.073120:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383476 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a39 expref: 15 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.073145:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575582.073270:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10314:x1876505676248064:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1296us (2140us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789575582.073281:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00080000:2.0:1789575582.073785:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575582.081672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575582.082600:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676248320 00000100:00100000:3.0:1789575582.082620:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676248320 00000100:00100000:2.0:1789575582.082868:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789575582.082885:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10314:x1876505676248320:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575582.083414:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10314:x1876505676248320:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 530us (1760us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789575582.083434:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789575582.121785:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699356928:0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.121931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575582.122022:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789575582.122030:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699356544:0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.122066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575582.122096:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699357056:0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.122147:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575582.122344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.122429:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699356800:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.122507:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356928 00000100:00100000:0.0:1789575582.122524:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356928 00000100:00100000:1.0:1789575582.122848:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356544 00000100:00100000:1.0:1789575582.122853:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356544 00000100:00100000:1.0:1789575582.122915:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789575582.122928:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699356544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.123002:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699356544:12345-0@lo:400:kworker.0 Request processed in 76us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.123010:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789575582.123081:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699356544:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.125092:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789575582.125141:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699356928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.125332:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699356928:12345-0@lo:400:kworker.0 Request processed in 213us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.125341:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789575582.125973:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575582.126052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699357184:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.126121:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575582.126192:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699357056 00000100:00100000:0.0:1789575582.126207:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699357056 00000100:00100000:0.0:1789575582.126284:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356672 00000100:00100000:0.0:1789575582.126288:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356672 00000100:00100000:0.0:1789575582.126314:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789575582.126322:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699357056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.127580:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876505699357056:12345-0@lo:400:kworker.0 Request processed in 92us (4264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.127598:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789575582.127648:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789575582.127670:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699356672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.127783:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699356672:12345-0@lo:400:kworker.0 Request processed in 126us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.127788:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1789575582.127822:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575582.127848:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575582.127912:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699356800 00000100:00100000:0.0:1789575582.127922:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699356800 00000100:00100000:0.0:1789575582.127967:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789575582.127973:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699356800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.128017:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699356800:12345-0@lo:400:kworker.0 Request processed in 42us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.128047:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1789575582.128062:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575582.128117:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699356800:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.128164:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699356672:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.128208:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699357056:0@lo:400:kworker.0 00000100:00100000:0.0:1789575582.128225:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699356928:0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.128623:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699357184 00000100:00100000:1.0:1789575582.128632:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699357184 00000100:00100000:1.0:1789575582.128701:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789575582.128710:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699357184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575582.128777:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699357184:12345-0@lo:400:kworker.0 Request processed in 69us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.128784:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789575582.128831:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699357184:0@lo:400:kworker.0 00000100:00080000:0.0:1789575582.130704:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575582.188717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.189552:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676248448 00000100:00100000:0.0:1789575582.189572:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676248448 00000100:00100000:0.0:1789575582.189683:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789575582.189700:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10320:x1876505676248448:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575582.189739:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575582.189775:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a40 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.189895:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.190295:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.190316:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575582.192075:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789575582.192092:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575582.192203:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.192264:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a40 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.192299:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a40 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.192311:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575582.192314:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575582.192320:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076a00, rc 0) 00000100:00100000:0.0:1789575582.192547:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10320:x1876505676248448:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2848us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.192560:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:3.0:1789575582.198040:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.199668:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676248704 00000100:00100000:0.0:1789575582.199698:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676248704 00000100:00100000:0.0:1789575582.199814:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789575582.199827:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10320:x1876505676248704:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575582.199857:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575582.199891:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383492 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a47 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.207767:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.207807:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.207825:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575582.207845:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789575582.208841:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383492 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a47 expref: 19 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.208889:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a47 expref: 18 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.209254:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:1.0:1789575582.209260:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575582.209266:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:1.0:1789575582.210013:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10320:x1876505676248704:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 10180us (11986us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789575582.210047:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789575582.217177:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575582.217265:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.218743:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676248960 00000100:00100000:0.0:1789575582.218768:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676248960 00000100:00100000:0.0:1789575582.218885:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789575582.218898:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2356:x1876505676248960:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575582.218927:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575582.218985:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a47 expref: 18 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.219015:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:0.0:1789575582.219022:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575582.219364:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249088 00000100:00100000:3.0:1789575582.219435:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249088 00000100:00100000:3.0:1789575582.219476:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789575582.219483:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10320:x1876505676249088:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575582.219511:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575582.219532:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223834a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a4e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.219672:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.219694:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.219710:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575582.219727:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789575582.219923:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223834a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a4e expref: 21 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.219958:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a4e expref: 20 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.219967:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575582.219970:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789575582.219973:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0a00, rc 0) 00000100:00100000:0.0:1789575582.220309:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+20:2356:x1876505676248960:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1410us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.220319:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:3.0:1789575582.222809:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10320:x1876505676249088:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3307us (5636us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789575582.222824:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789575582.238750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.239064:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249216 00000100:00100000:0.0:1789575582.239080:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249216 00000100:00100000:0.0:1789575582.239183:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:0.0:1789575582.239197:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676249216:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:0.0:1789575582.239271:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.239300:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.239311:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575582.239316:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575582.239322:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.239445:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.239467:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 7 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575582.239520:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699357312:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575582.239673:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575582.246713:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc399880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699357312:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575582.246766:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575582.251557:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575582.255514:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249344 00000100:00100000:3.0:1789575582.255546:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249344 00002000:00100000:3.0:1789575582.255632:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e96bd0f6300 x1876505676249344/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:603/0 lens 504/0 e 0 to 0 dl 1789575593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575582.255648:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bd0f6300 with x1876505676249344 ext(0->12) 00010000:00010000:3.0:1789575582.255662:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 8 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.255685:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 8 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575582.255694:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bd0f6300 00000100:00100000:3.0:1789575582.255747:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789575582.255761:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676249344:12345-192.168.202.32@tcp:4:lfs.0 00000001:00100000:2.0:1789575582.358579:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000100:00100000:2.0:1789575582.361424:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676249344:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 105593us (109932us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789575582.361460:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00002000:00100000:2.0:1789575582.361487:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e96bd0f6300 x1876505676249344/t4294967299(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:603/0 lens 504/448 e 0 to 0 dl 1789575593 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789575582.361502:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bd0f6300 with x1876505676249344 ext(0->12) 00010000:00010000:2.0:1789575582.361520:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.361555:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575582.361565:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bd0f6300 00000100:00100000:3.0:1789575582.370664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575582.371454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249472 00000100:00100000:1.0:1789575582.371475:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249472 00010000:00010000:1.0:1789575582.371545:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575582.371602:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789575582.371615:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2358:x1876505676249472:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575582.371642:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789575582.371676:0:5847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789575582.371681:0:5847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789575582 00002000:00010000:1.0:1789575582.371683:0:5847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789575582 00002000:00010000:1.0:1789575582.371686:0:5847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789575582 00010000:00010000:1.0:1789575582.371695:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.371714:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.371748:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a2238346f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a32 expref: 9 pid: 9232 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.371774:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575582.371780:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575582.371788:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.371816:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.371868:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575582.371953:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676249472:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 340us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.371962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00010000:00010000:2.0:1789575582.378629:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378662:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378726:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378762:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378772:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378780:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575582.378786:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378797:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378828:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.378836:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062ad7aed/0xc45cc82a223834bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575582.378983:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676249216:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 139777us (140239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575582.378999:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575582.386848:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.387143:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249728 00000100:00100000:0.0:1789575582.387164:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249728 00000100:00100000:0.0:1789575582.387305:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789575582.387322:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10320:x1876505676249728:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:0.0:1789575582.387491:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a4e expref: 19 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575582.388003:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789575582.388077:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789575582.401527:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789575582.401691:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.401728:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 23 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.401740:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.401801:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 23 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.401822:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 23 pid: 5864 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575582.401841:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5865:1876505699357440:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575582.403325:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683029e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575582.409268:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5865:1876505699357440:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575582.409327:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575582.426639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575582.426972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249856 00000100:00100000:1.0:1789575582.426987:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249856 00010000:00010000:1.0:1789575582.427070:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 24 pid: 5864 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575582.427144:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:1.0:1789575582.427159:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+24:2357:x1876505676249856:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575582.427187:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575582.427200:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 24 pid: 5864 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427220:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 24 pid: 5864 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427251:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a24 expref: 24 pid: 5864 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427276:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:1.0:1789575582.427286:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427301:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427310:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.427354:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575582.428733:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+23:2357:x1876505676249856:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1560us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.428753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00010000:00010000:3.0:1789575582.430650:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.430671:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575582.430916:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789575582.431250:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789575582.435193:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699357568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789575582.446779:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575582.446856:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777600 going to sleep for 11 seconds 00000100:00100000:1.0:1789575582.446899:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699357568 00000100:00100000:1.0:1789575582.446921:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699357568 00000100:00100000:1.0:1789575582.447083:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575582.447107:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1876505699357568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789575582.447301:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1876505699357568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 206us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.447309:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575582.447487:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699357568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789575582.448365:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789575582.448530:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699357696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789575582.448606:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575582.455999:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777780 going to sleep for 11 seconds 00000100:00100000:0.0:1789575582.463598:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699357696 00000100:00100000:0.0:1789575582.463636:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699357696 00000100:00100000:0.0:1789575582.463763:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575582.463781:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5865:x1876505699357696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789575582.464282:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5865:x1876505699357696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 505us (15674us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789575582.464291:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575582.469625:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699357696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789575582.469791:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789575582.469877:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469889:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469917:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469923:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575582.469929:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469937:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469959:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575582.469963:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789575582.469969:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575582.469977:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223834c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575582.470268:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789575582.470610:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789575582.470624:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394557252682ns, next at 395557250624ns, rc = 0 00000001:00080000:3.0:1789575582.470631:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789575582.470672:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575582.470676:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789575582.470687:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223834ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a4e expref: 27 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575582.470838:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10320:x1876505676249728:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 83521us (84005us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789575582.470861:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000020:00080000:3.0:1789575582.470871:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789575582.479335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575582.479876:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676249984 00000100:00100000:0.0:1789575582.479891:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676249984 00000100:00100000:0.0:1789575582.480001:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789575582.480014:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10320:x1876505676249984:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575582.480052:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575582.480090:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223834ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a55 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.480199:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223834ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a55 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.480218:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223834ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a55 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575582.480240:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575582.480244:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575582.480248:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:0.0:1789575582.480340:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10320:x1876505676249984:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 329us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575582.480347:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789575582.489899:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575582.491390:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676250240 00000100:00100000:2.0:1789575582.491413:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676250240 00000100:00100000:2.0:1789575582.491500:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789575582.491533:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10320:x1876505676250240:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575582.496613:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+28:10320:x1876505676250240:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 5046us (6694us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789575582.496635:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789575582.612325:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575582.612668:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676250496 00000100:00100000:1.0:1789575582.612685:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676250496 00000100:00100000:1.0:1789575582.612775:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:1.0:1789575582.612788:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+28:10330:x1876505676250496:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575582.612825:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575582.612854:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223834d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a5c expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575582.612987:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789575582.613326:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223834d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a5c expref: 30 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.613344:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:1.0:1789575582.613348:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575582.613355:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223834d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a5c expref: 30 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575582.613403:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:1.0:1789575582.613556:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10330:x1876505676250496:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 771us (1248us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789575582.613584:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:1.0:1789575582.619761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575582.619912:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676250624 00000100:00100000:2.0:1789575582.619930:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676250624 00000100:00100000:2.0:1789575582.620015:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789575582.620031:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10330:x1876505676250624:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789575582.620437:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620470:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620486:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620511:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620520:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620527:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620727:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620736:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620760:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575582.620813:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620829:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620836:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620845:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620851:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.620856:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620864:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620879:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575582.620882:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575582.620887:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620894:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223834df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620908:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620921:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620927:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620932:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.620936:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620943:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620951:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9683773200) 00010000:00010000:2.0:1789575582.620953:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575582.620957:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620963:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620979:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620985:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620991:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.620996:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.621005:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.621012:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.621020:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575582.621022:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575582.621025:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.621032:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575582.621642:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10330:x1876505676250624:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1606us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575582.621654:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:0.0:1789575582.627925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575582.629225:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676250880 00000100:00100000:3.0:1789575582.629248:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676250880 00000100:00100000:3.0:1789575582.629587:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789575582.629604:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10330:x1876505676250880:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575582.630887:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+30:10330:x1876505676250880:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1280us (2972us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789575582.630899:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789575582.633517:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575582.633556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699357824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575582.633672:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575582.633725:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699357824 00000100:00100000:1.0:1789575582.633738:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699357824 00000100:00100000:1.0:1789575582.633817:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789575582.633831:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699357824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575582.633893:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575582.633962:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699357824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575582.633970:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789575582.633997:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699357824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575582.696739:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:3.0:1789575582.697529:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575582.698465:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676251136 00000100:00100000:2.0:1789575582.698491:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676251136 00000100:00100000:2.0:1789575582.698617:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789575582.698632:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+30:10333:x1876505676251136:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575582.698673:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575582.698711:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a63 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698838:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698858:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698899:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698918:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698925:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.698931:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702280:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702311:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702329:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575582.702350:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789575582.702562:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702586:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702596:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702603:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.702634:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702645:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702666:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575582.702670:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575582.702676:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702685:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223834fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702708:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702716:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702723:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702729:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.702731:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702738:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702748:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9683773200) 00010000:00010000:2.0:1789575582.702750:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575582.702761:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702768:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702861:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223834f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 33 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702882:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 32 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.702892:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575582.702895:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575582.702898:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:2.0:1789575582.703034:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10333:x1876505676251136:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4404us (6311us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789575582.703048:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:1.0:1789575582.710812:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575582.711004:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676251264 00000100:00100000:2.0:1789575582.711019:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676251264 00000100:00100000:2.0:1789575582.711110:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789575582.711124:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10333:x1876505676251264:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:2.0:1789575582.711225:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711248:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711579:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711640:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711647:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711654:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711660:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575582.711666:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711675:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711690:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575582.711694:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575582.711699:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575582.711706:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575582.711815:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10333:x1876505676251264:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 694us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575582.711823:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789575582.715135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575582.715262:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676251520 00000100:00100000:2.0:1789575582.715281:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676251520 00000100:00100000:2.0:1789575582.715427:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789575582.715467:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10333:x1876505676251520:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575582.716009:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+33:10333:x1876505676251520:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 543us (893us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789575582.716021:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789575583.152734:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.153100:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676251776 00000100:00100000:2.0:1789575583.153121:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676251776 00000100:00100000:2.0:1789575583.153726:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789575583.153745:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+33:10363:x1876505676251776:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789575583.153786:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575583.153828:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238351e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a6a expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.154015:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.154038:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.154058:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575583.154075:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789575583.154643:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238351e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a6a expref: 36 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.154674:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a6a expref: 35 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.154716:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575583.154720:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575583.154725:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8a00, rc 0) 00000100:00100000:2.0:1789575583.154902:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10363:x1876505676251776:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1161us (2188us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789575583.154913:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:1.0:1789575583.176192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.176337:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252032 00000100:00100000:2.0:1789575583.176355:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252032 00000100:00100000:2.0:1789575583.176609:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575583.176628:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10363:x1876505676252032:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:2.0:1789575583.179692:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+36:10363:x1876505676252032:12345-192.168.202.32@tcp:35:cat.0 Request processed in 3044us (3497us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789575583.179713:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789575583.190126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575583.190358:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252160 00000100:00100000:1.0:1789575583.190413:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252160 00000100:00100000:1.0:1789575583.190520:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:1.0:1789575583.190538:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+36:2355:x1876505676252160:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575583.190568:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575583.190615:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a6a expref: 36 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.190650:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575583.190658:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575583.190776:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+35:2355:x1876505676252160:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 243us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575583.190786:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789575583.260750:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.263074:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252416 00000100:00100000:2.0:1789575583.263109:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252416 00000100:00100000:2.0:1789575583.263364:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789575583.263451:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10370:x1876505676252416:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:2.0:1789575583.263492:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575583.263497:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789575583.263536:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238348b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a40 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.263786:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575583.263795:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575583.263818:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383533 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a71 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.264355:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.264471:0:9231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 35 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.264481:0:9231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.264536:0:9231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 35 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.264554:0:9231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 35 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575583.267224:0:9231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699357952:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575583.268046:0:9231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9682f4d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575583.276435:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.276647:0:9231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699357952:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575583.276698:0:9231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575583.277080:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252544 00000100:00100000:0.0:1789575583.277101:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252544 00010000:00010000:0.0:1789575583.277159:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 36 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575583.277218:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:0.0:1789575583.277228:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+36:2358:x1876505676252544:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575583.277247:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575583.277256:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 36 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277270:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 36 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277298:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a63 expref: 36 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277318:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575583.277324:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277337:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277345:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.277499:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575583.277592:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:2358:x1876505676252544:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 363us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575583.277601:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00010000:00010000:2.0:1789575583.283622:0:9231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.283654:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575583.283698:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789575583.284095:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383533 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 36 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.284131:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 35 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.284141:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575583.284145:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789575583.284151:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:2.0:1789575583.284285:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10370:x1876505676252416:12345-192.168.202.32@tcp:101:dd.0 Request processed in 20838us (23548us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789575583.284300:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:1.0:1789575583.292651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575583.293423:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252800 00000100:00100000:0.0:1789575583.293470:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252800 00000100:00100000:0.0:1789575583.293583:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789575583.293599:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10370:x1876505676252800:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:0.0:1789575583.294730:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.294767:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575583.294783:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575583.294873:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789575583.294911:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089bc4e85 reply state 00000000c4793866 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575583.294923:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789575583.296197:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+38:10370:x1876505676252800:12345-192.168.202.32@tcp:36:dd.0 Request processed in 2590us (3554us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789575583.296209:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000020:00080000:0.0:1789575583.296216:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575583.302526:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302553:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302572:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302580:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575583.302586:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302596:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302619:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575583.302623:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575583.302628:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.302637:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789575583.657161:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789575583.724590:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575583.733263:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.734519:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676252928 00000100:00100000:2.0:1789575583.734535:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676252928 00000100:00100000:2.0:1789575583.734612:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789575583.734622:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+37:10384:x1876505676252928:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:2.0:1789575583.734650:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575583.734674:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238354f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a78 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734745:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734760:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734770:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734805:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734811:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.734815:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.735095:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.735110:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 38 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.735124:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.735175:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 38 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.735193:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 38 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575583.735210:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699358080:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575583.743810:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9682f4d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575583.747683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575583.748157:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699358080:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575583.748199:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575583.748305:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676253184 00000100:00100000:1.0:1789575583.748317:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676253184 00000100:00100000:1.0:1789575583.748655:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789575583.748667:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+39:5598:x1876505676253184:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789575583.749180:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+40:5598:x1876505676253184:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 515us (1519us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789575583.749206:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789575583.753075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575583.753364:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676253312 00000100:00100000:1.0:1789575583.753545:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676253312 00010000:00010000:1.0:1789575583.753622:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 40 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575583.753686:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:1.0:1789575583.753700:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+40:2358:x1876505676253312:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575583.753728:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575583.753738:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 40 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.753757:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 40 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.753789:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238353a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a71 expref: 40 pid: 9231 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.753816:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575583.753823:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.753836:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.753848:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.754132:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575583.754335:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754355:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575583.754482:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789575583.754489:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575583.754559:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754578:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754593:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754600:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754607:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754614:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575583.754619:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754629:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754642:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575583.754645:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575583.754650:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754656:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754682:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754689:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754695:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754701:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575583.754704:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754710:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754719:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9683773200) 00010000:00010000:3.0:1789575583.754722:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575583.754726:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754732:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238355d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754785:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238354f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a78 expref: 40 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754803:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a78 expref: 39 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575583.754823:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:3.0:1789575583.754826:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575583.754829:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:1.0:1789575583.755144:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+39:2358:x1876505676253312:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1442us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575583.755159:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789575583.755357:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+38:10384:x1876505676252928:12345-192.168.202.32@tcp:101:stat.0 Request processed in 20735us (22111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575583.755365:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:3.0:1789575583.848278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575583.848736:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676253568 00000100:00100000:2.0:1789575583.848819:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676253568 00000100:00100000:2.0:1789575583.848980:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789575583.848993:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+38:10390:x1876505676253568:12345-192.168.202.32@tcp:36:truncate.0 00010000:00010000:2.0:1789575583.849136:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575583.849175:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a78 expref: 38 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.849203:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575583.849209:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575583.849578:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.849602:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575583.849618:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575583.849699:0:9231:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789575583.849732:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088477c3a reply state 000000004f6cafeb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575583.849819:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575583.850017:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+40:10390:x1876505676253568:12345-192.168.202.32@tcp:36:truncate.0 Request processed in 1024us (1756us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789575583.850027:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000020:00080000:2.0:1789575583.850034:0:9231:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575583.853158:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853187:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853196:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853202:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575583.853208:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853217:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853239:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575583.853241:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575583.853247:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575583.853253:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a2238356b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575584.021521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.021673:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676253696 00000100:00100000:0.0:1789575584.021688:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676253696 00000100:00100000:0.0:1789575584.021853:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:0.0:1789575584.021868:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+39:10404:x1876505676253696:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:0.0:1789575584.021903:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.021934:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383572 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a7f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022048:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022065:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022102:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022123:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022130:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022137:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022259:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022268:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022275:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575584.022321:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789575584.022327:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575584.022358:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022449:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022459:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022466:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022473:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022480:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.022485:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022493:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022508:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575584.022512:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.022519:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022526:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022543:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022549:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022575:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022579:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.022582:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022589:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022598:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9000) 00010000:00010000:0.0:1789575584.022600:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.022603:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022610:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022653:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383572 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022672:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.022680:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575584.022682:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575584.022685:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076a00, rc 0) 00000100:00100000:0.0:1789575584.022775:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+40:10404:x1876505676253696:12345-192.168.202.32@tcp:101:stat.0 Request processed in 911us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.022798:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00080000:2.0:1789575584.023402:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575584.106902:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.107050:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676253952 00000100:00100000:0.0:1789575584.107065:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676253952 00000100:00100000:0.0:1789575584.107162:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:0.0:1789575584.107176:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+40:10414:x1876505676253952:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575584.107207:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.107242:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238358e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a86 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575584.107705:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789575584.107888:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238358e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a86 expref: 42 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.107905:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:0.0:1789575584.107908:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575584.107914:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238358e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a86 expref: 42 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.107933:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575584.108021:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+41:10414:x1876505676253952:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 848us (1138us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789575584.108030:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:3.0:1789575584.111010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.111587:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676254208 00000100:00100000:1.0:1789575584.111601:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676254208 00000100:00100000:1.0:1789575584.111699:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:1.0:1789575584.111712:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+41:10414:x1876505676254208:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789575584.112028:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+42:10414:x1876505676254208:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 319us (1034us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789575584.112035:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575584.173462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575584.174065:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676254464 00000100:00100000:2.0:1789575584.174092:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676254464 00000100:00100000:2.0:1789575584.174180:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789575584.174195:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+42:10420:x1876505676254464:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575584.174262:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575584.174291:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238359c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a8d expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.174491:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.174511:0:9231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.174521:0:9231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.174580:0:9231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.174596:0:9231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 43 pid: 5863 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575584.174613:0:9231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699358208:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575584.174963:0:9231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575584.183582:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.183730:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676254592 00000100:00100000:0.0:1789575584.183748:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676254592 00010000:00010000:0.0:1789575584.183810:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 44 pid: 5863 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575584.183895:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:0.0:1789575584.183908:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+44:2357:x1876505676254592:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575584.183936:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575584.183947:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 44 pid: 5863 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.183965:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 44 pid: 5863 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.183999:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575584.184006:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.184020:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.184030:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.184058:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575584.184152:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+44:2357:x1876505676254592:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 247us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.184160:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00010000:00010000:2.0:1789575584.184583:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a7f expref: 43 pid: 5863 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575584.184610:0:9231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699358208:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575584.184640:0:9231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.184667:0:9231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.184673:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575584.184702:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789575584.184929:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238359c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 44 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.184949:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 43 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.184959:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:2.0:1789575584.184963:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789575584.184966:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8a00, rc 0) 00000100:00100000:2.0:1789575584.185026:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+43:10420:x1876505676254464:12345-192.168.202.32@tcp:101:bash.0 Request processed in 10835us (11584us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789575584.185034:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:3.0:1789575584.189998:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.190131:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676254848 00000100:00100000:1.0:1789575584.190151:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676254848 00000100:00100000:1.0:1789575584.190248:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:1.0:1789575584.190262:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+43:10420:x1876505676254848:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:1.0:1789575584.190817:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.190847:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.190864:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575584.190937:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789575584.190968:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe57d775 reply state 000000006bede53d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575584.190979:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789575584.191132:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+46:10420:x1876505676254848:12345-192.168.202.32@tcp:36:bash.0 Request processed in 869us (1151us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789575584.191142:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000020:00080000:1.0:1789575584.191149:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575584.194247:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194295:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194304:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194311:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.194318:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194328:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194353:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.194357:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575584.194365:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.194480:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575584.199059:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.199317:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676254976 00000100:00100000:0.0:1789575584.199333:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676254976 00000100:00100000:0.0:1789575584.199464:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:0.0:1789575584.199477:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:10420:x1876505676254976:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789575584.199532:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.199561:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a94 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.199678:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.199696:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 46 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.199707:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.199751:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 46 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.199769:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 46 pid: 9231 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575584.199786:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699358336:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575584.199901:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575584.204000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.204169:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676255104 00000100:00100000:1.0:1789575584.204188:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676255104 00010000:00010000:1.0:1789575584.204255:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 47 pid: 9231 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575584.204322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:1.0:1789575584.204337:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+47:2358:x1876505676255104:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575584.204362:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575584.204452:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 47 pid: 9231 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.204471:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 47 pid: 9231 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.204508:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.204516:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.204531:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.204542:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.204574:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575584.204653:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+47:2358:x1876505676255104:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 319us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.204661:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00010000:00010000:0.0:1789575584.204964:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223835a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a8d expref: 46 pid: 9231 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575584.204989:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699358336:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575584.205021:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.205046:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.205064:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575584.205160:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789575584.205167:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575584.205208:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.205248:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a94 expref: 46 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.205269:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a94 expref: 45 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.205278:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575584.205281:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575584.205284:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575584.205324:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:10420:x1876505676254976:12345-192.168.202.32@tcp:101:bash.0 Request processed in 5849us (6281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.205332:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789575584.209800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.209960:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676255360 00000100:00100000:3.0:1789575584.209973:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676255360 00000100:00100000:3.0:1789575584.210057:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575584.210071:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690789c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+45:10420:x1876505676255360:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789575584.210900:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690789c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+46:10420:x1876505676255360:12345-192.168.202.32@tcp:35:bash.0 Request processed in 824us (1108us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789575584.210912:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575584.311310:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575584.311538:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676255616 00000100:00100000:2.0:1789575584.311563:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676255616 00000100:00100000:2.0:1789575584.311648:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789575584.311662:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+46:10430:x1876505676255616:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575584.311697:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575584.311726:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223835c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5a9b expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575584.311893:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789575584.312070:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223835c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a9b expref: 48 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.312099:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:2.0:1789575584.312103:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575584.312110:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223835c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a9b expref: 48 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.312129:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:2.0:1789575584.312229:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10430:x1876505676255616:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 569us (936us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789575584.312237:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:0.0:1789575584.317931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.318126:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676255744 00000100:00100000:1.0:1789575584.318145:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676255744 00000100:00100000:1.0:1789575584.318248:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:1.0:1789575584.318263:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10430:x1876505676255744:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:1.0:1789575584.318453:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318480:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318528:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318757:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318769:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318777:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318915:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318924:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.318931:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789575584.319001:0:7184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319023:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319031:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319041:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319059:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.319065:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319074:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319106:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:1.0:1789575584.319110:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575584.319117:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319125:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223835d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319142:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319148:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319153:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319157:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.319159:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319165:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319184:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e96831e1100) 00010000:00010000:1.0:1789575584.319186:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575584.319189:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319196:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223835db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319213:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319219:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319224:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319230:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.319232:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319238:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319246:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.319248:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575584.319251:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.319256:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223835e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575584.319732:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10430:x1876505676255744:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1466us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.319745:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:1.0:1789575584.324002:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575584.324254:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676256000 00000100:00100000:2.0:1789575584.324269:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676256000 00000100:00100000:2.0:1789575584.324636:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789575584.324650:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10430:x1876505676256000:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575584.325029:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+48:10430:x1876505676256000:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 381us (1042us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789575584.325039:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789575584.369806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.369975:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676256256 00000100:00100000:0.0:1789575584.369990:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676256256 00000100:00100000:0.0:1789575584.370070:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:0.0:1789575584.370116:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+48:10433:x1876505676256256:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575584.370170:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.370200:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223835e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5aa2 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370305:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370323:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370338:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370358:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370366:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370619:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370797:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223835fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370806:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223835fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370814:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223835fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575584.370826:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789575584.370974:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370982:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370990:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.370996:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.371001:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371008:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371023:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575584.371026:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.371032:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371039:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223835f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371057:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371064:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371070:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371320:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.371334:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371341:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371350:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9000) 00010000:00010000:0.0:1789575584.371353:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.371356:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.371362:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a223835f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.374178:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223835e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa2 expref: 51 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.374218:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223835fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa2 expref: 50 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.374229:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575584.374232:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575584.374237:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076a00, rc 0) 00000100:00100000:0.0:1789575584.374510:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+50:10433:x1876505676256256:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4427us (4718us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789575584.374523:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:0.0:1789575584.389042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.389492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.389527:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676256512 00000100:00100000:0.0:1789575584.389541:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676256512 00000100:00100000:0.0:1789575584.389655:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789575584.389666:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+50:2357:x1876505676256512:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575584.389687:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575584.389742:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223835fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa2 expref: 50 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.389769:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:0.0:1789575584.389775:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575584.389848:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+49:2357:x1876505676256512:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 184us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.389856:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789575584.392038:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676256384 00000100:00100000:1.0:1789575584.392149:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676256384 00000100:00100000:1.0:1789575584.392341:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:1.0:1789575584.392356:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10433:x1876505676256384:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:1.0:1789575584.392505:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392530:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392548:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392596:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392604:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392612:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392619:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.392625:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392660:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392676:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.392679:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575584.392685:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.392693:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238360c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575584.392827:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10433:x1876505676256384:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 475us (3803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.392836:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:0.0:1789575584.398735:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.398850:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676256768 00000100:00100000:3.0:1789575584.398866:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676256768 00000100:00100000:3.0:1789575584.399004:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789575584.399018:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10433:x1876505676256768:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575584.399414:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+50:10433:x1876505676256768:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 358us (657us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789575584.399424:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789575584.551965:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.552274:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257024 00000100:00100000:1.0:1789575584.552288:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257024 00000100:00100000:1.0:1789575584.552494:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:1.0:1789575584.552507:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+50:10451:x1876505676257024:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789575584.552546:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575584.552765:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5aa9 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.552976:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238361a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.553000:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238361a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.553020:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238361a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575584.553048:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789575584.553451:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa9 expref: 53 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.553481:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238361a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa9 expref: 52 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.553493:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.553496:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789575584.553502:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:1.0:1789575584.554357:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10451:x1876505676257024:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1843us (2401us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789575584.554425:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:0.0:1789575584.602132:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.602328:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257152 00000100:00100000:3.0:1789575584.602343:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257152 00000100:00100000:3.0:1789575584.602483:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:3.0:1789575584.602498:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10452:x1876505676257152:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575584.602539:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575584.602577:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ab0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602683:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602703:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602718:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575584.602771:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789575584.602776:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575584.602799:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602832:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab0 expref: 54 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602888:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab0 expref: 53 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.602899:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575584.602903:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575584.602908:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0a00, rc 0) 00000100:00100000:3.0:1789575584.603009:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10452:x1876505676257152:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 515us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575584.603018:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:0.0:1789575584.609276:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575584.610235:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257536 00000100:00100000:2.0:1789575584.610258:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257536 00000100:00100000:2.0:1789575584.610362:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789575584.610431:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10452:x1876505676257536:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575584.611429:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10452:x1876505676257536:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1045us (2162us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789575584.611443:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789575584.617694:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.617875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257664 00000100:00100000:1.0:1789575584.617896:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257664 00000100:00100000:1.0:1789575584.618042:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789575584.618056:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10452:x1876505676257664:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:1.0:1789575584.618098:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789575584.618138:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223835bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a94 expref: 54 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.618175:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238361a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aa9 expref: 53 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.618190:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223834ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a55 expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.618232:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575584.618249:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575584.618342:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10452:x1876505676257664:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 289us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.618350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789575584.621613:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.621857:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257792 00000100:00100000:1.0:1789575584.621873:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257792 00000100:00100000:1.0:1789575584.621956:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789575584.621970:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10452:x1876505676257792:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:1.0:1789575584.622160:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.622181:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.622197:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789575584.627138:0:5862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789575584.628247:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789575584.628349:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789575584.632313:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10452:x1876505676257792:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 10327us (10698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.632333:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000040:00080000:3.0:1789575584.681294:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575584.681308:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575584.681561:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789575584.681573:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575584.681771:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3e2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699358464:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575584.681923:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9584777c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789575584.682331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.683042:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676257920 00000100:00100000:3.0:1789575584.683060:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676257920 00000100:00100000:3.0:1789575584.692811:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.692862:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258048 00000100:00100000:3.0:1789575584.692875:0:5873:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258048 00000100:00100000:3.0:1789575584.692950:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:3.0:1789575584.692965:0:5873:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258048:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789575584.693098:0:5873:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258048:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575584.693107:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:3.0:1789575584.693187:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3e2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699358464:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575584.693483:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:3.0:1789575584.693491:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10454:x1876505676257920:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575584.693504:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575584.693531:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a2238363d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ab7 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693615:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693635:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693649:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693668:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693676:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.693683:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.694058:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.694069:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695000:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575584.695061:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789575584.695066:0:7184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575584.695101:0:7184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695120:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695131:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695139:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695148:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695155:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575584.695161:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695169:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695184:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575584.695187:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575584.695194:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695212:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695228:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695235:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695242:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695247:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575584.695250:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695256:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695264:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575584.695266:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575584.695269:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695274:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a2238364b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695322:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a2238363d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 53 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695336:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 52 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.695349:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:3.0:1789575584.695352:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575584.695355:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575584.695488:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10454:x1876505676257920:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1995us (13158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575584.695497:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789575584.716129:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.716189:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258176 00000100:00100000:0.0:1789575584.716206:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258176 00000100:00100000:0.0:1789575584.716290:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789575584.716305:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10456:x1876505676258176:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789575584.716353:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789575584.717767:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10456:x1876505676258176:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 1454us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.717783:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:2.0:1789575584.730727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.736654:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258304 00000100:00100000:0.0:1789575584.736679:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258304 00000100:00100000:0.0:1789575584.736787:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789575584.736823:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10456:x1876505676258304:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789575584.736949:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.736971:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.736987:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737006:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737013:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737020:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737056:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737066:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737084:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575584.737142:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789575584.737148:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575584.737168:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737196:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737203:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737212:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737218:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.737223:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737232:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737247:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:0.0:1789575584.737250:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.737257:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737264:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22383659 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737280:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737288:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737293:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737306:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.737309:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737316:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737325:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e9687dc9000) 00010000:00010000:0.0:1789575584.737327:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.737330:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737336:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383660 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737353:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737359:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737364:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.737410:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.741502:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.741536:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.742000:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:0.0:1789575584.742004:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.742014:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.742023:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22383667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.744876:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575584.745165:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10456:x1876505676258304:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 8333us (14442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.745183:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789575584.763521:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575584.763632:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258560 00000100:00100000:3.0:1789575584.763664:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258560 00000100:00100000:3.0:1789575584.763745:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:3.0:1789575584.763758:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10456:x1876505676258560:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575584.763789:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575584.763819:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a2238366e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5abe expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764003:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764025:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764043:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575584.764059:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789575584.764349:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764359:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764418:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764425:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575584.764430:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764440:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764454:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:3.0:1789575584.764458:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575584.764466:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764473:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764540:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a2238366e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5abe expref: 54 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764553:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:3.0:1789575584.764556:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575584.764560:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a2238366e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5abe expref: 54 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575584.764570:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575584.764665:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258560:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 908us (1161us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789575584.764685:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:2.0:1789575584.770327:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.771525:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258688 00000100:00100000:0.0:1789575584.771542:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258688 00000100:00100000:0.0:1789575584.771913:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:0.0:1789575584.771927:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258688:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789575584.772019:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789575584.772192:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258688:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 267us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.772202:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:2.0:1789575584.789881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.790169:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676258944 00000100:00100000:0.0:1789575584.790186:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676258944 00000100:00100000:0.0:1789575584.790277:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:0.0:1789575584.790291:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10456:x1876505676258944:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575584.790323:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.790328:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789575584.790445:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238362f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab0 expref: 53 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.790474:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575584.790481:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575584.790501:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383683 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ac5 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575584.798879:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789575584.799286:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a2238368a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.799311:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a2238368a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.799327:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a2238368a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.799455:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a22383683 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ac5 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.799482:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a2238368a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ac5 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.799491:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9000) 00010000:00010000:0.0:1789575584.799494:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575584.799499:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156400, rc 0) 00000100:00100000:0.0:1789575584.799593:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10456:x1876505676258944:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 9303us (9726us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789575584.799618:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:2.0:1789575584.807768:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.807942:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259200 00000100:00100000:1.0:1789575584.807980:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259200 00000100:00100000:1.0:1789575584.808071:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:1.0:1789575584.808094:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10456:x1876505676259200:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789575584.808189:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575584.808230:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a2238368a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ac5 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.808263:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9000) 00010000:00010000:1.0:1789575584.808283:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575584.808328:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.808350:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.808364:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.810700:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.810729:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.810744:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575584.813820:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000001:00080000:0.0:1789575584.813871:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1789575584.813905:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1789575584.813954:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789575584.813988:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9584777600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789575584.813994:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bbda3d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e95847770c0 00000020:00080000:0.0:1789575584.813999:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bbda3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9699d13400 00000020:00080000:0.0:1789575584.814041:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1789575584.814232:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789575584.814476:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575584.814503:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699358592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789575584.814616:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575584.816765:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699358592 00000100:00100000:1.0:1789575584.816781:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699358592 00000100:00100000:1.0:1789575584.816871:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789575584.816886:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699358592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789575584.816937:0:9232:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789575584.816978:0:9232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aaac19e, atime: 0x6aaac19e, ctime: 0x6aaac19e, blocks: 0x1 00010000:00010000:1.0:1789575584.816987:0:9232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.817006:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1789575584.817011:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575584.817018:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.817035:0:9232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.817046:0:9232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.817054:0:9232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.817085:0:9232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789575584.818030:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1876505699358592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1148us (3412us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789575584.818040:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789575584.818196:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818214:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818222:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818229:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.818236:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818245:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818264:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575584.818268:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.818289:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818296:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383698 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818317:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818324:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818330:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818335:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575584.818339:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818345:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818354:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf62bdc40 (ffff8e96831e1800) 00010000:00010000:0.0:1789575584.818356:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575584.818359:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.818365:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a2238369f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf62bdc40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819595:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575584.819611:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819783:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575584.819788:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819800:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819899:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819908:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7a1db7/0xc45cc82a223836a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.819950:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575584.819951:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+12:10456:x1876505676259200:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 11844us (12188us total) trans 0 rc -2/-2 00010000:00010000:1.0:1789575584.819954:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575584.819959:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575584.819986:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00080000:3.0:1789575584.820499:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789575584.823246:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bc946d80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789575584.823275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699358592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789575584.830801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.831584:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259328 00000100:00100000:0.0:1789575584.831607:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259328 00000100:00100000:0.0:1789575584.831720:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:0.0:1789575584.831736:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+12:10456:x1876505676259328:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575584.831767:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.831807:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5acc expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.831869:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.831892:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.831911:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.832087:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 14 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.832119:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 13 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.832131:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575584.832135:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789575584.832139:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2157c00, rc 0) 00000100:00100000:0.0:1789575584.832254:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10456:x1876505676259328:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 522us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.832275:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:0.0:1789575584.837574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575584.837838:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259584 00000100:00100000:2.0:1789575584.837858:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259584 00000100:00100000:2.0:1789575584.837932:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:2.0:1789575584.837944:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10456:x1876505676259584:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575584.838044:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.838065:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575584.838088:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575584.838476:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789575584.838489:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396925116784ns, next at 397925114355ns, rc = 0 00000004:00010000:2.0:1789575584.838600:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab33785c reply state 00000000c61697d5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575584.838610:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575584.838768:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10456:x1876505676259584:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 815us (1215us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789575584.838777:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00010000:00010000:1.0:1789575584.849009:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.849035:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.849045:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.849057:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575584.849071:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575584.849080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.849165:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259712 00000100:00100000:0.0:1789575584.849183:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259712 00000100:00100000:0.0:1789575584.849280:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:0.0:1789575584.849294:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10456:x1876505676259712:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575584.849331:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575584.849363:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ad3 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.849489:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 16 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.849509:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 16 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575584.849535:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575584.849539:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575584.849543:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156600, rc 0) 00000100:00100000:0.0:1789575584.849641:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10456:x1876505676259712:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 350us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575584.849755:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00010000:00010000:1.0:1789575584.849958:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.849974:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:1.0:1789575584.849976:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789575584.849981:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575584.849988:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223836bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575584.866954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575584.867062:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259840 00000100:00100000:1.0:1789575584.867092:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259840 00000100:00100000:1.0:1789575584.867302:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789575584.867317:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876505676259840:12345-192.168.202.32@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789575584.867364:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp t0 exp 0000000000000000 cur 396 last 0 00000020:00000080:1.0:1789575584.867435:0:6706:0:(genops.c:1384:class_connect()) connect: client 22a2b54c-4bca-4302-892e-490c3310b8b3, cookie 0xc45cc82a223836c9 00002000:00100000:1.0:1789575584.867451:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22a2b54c-4bca-4302-892e-490c3310b8b3/ffff8e96c1275000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789575584.867482:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789575584.869580:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789575584.869643:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e96c1275800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575584.869814:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2354:x1876505676259840:12345-192.168.202.32@tcp:8:lhsmtool_posix.0 Request processed in 2494us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575584.869829:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789575584.880749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575584.880793:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676259968 00000100:00100000:0.0:1789575584.880814:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676259968 00000100:00100000:0.0:1789575584.880897:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789575584.880910:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:0:x1876505676259968:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789575584.881210:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789575585.009349:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1789575585.009434:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000100:00100000:1.0:1789575585.011482:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:0:x1876505676259968:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 130563us (130733us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789575585.011514:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789575585.031920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575585.032085:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676260224 00000100:00100000:2.0:1789575585.032099:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676260224 00000100:00100000:2.0:1789575585.032191:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:2.0:1789575585.032205:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10456:x1876505676260224:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789575585.032766:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10456:x1876505676260224:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 562us (858us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789575585.032777:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789575585.042714:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575585.042827:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676260480 00000100:00100000:1.0:1789575585.042838:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676260480 00000100:00100000:1.0:1789575585.042897:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:1.0:1789575585.042907:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10456:x1876505676260480:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789575585.043020:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10456:x1876505676260480:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 115us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575585.043027:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:3.0:1789575585.062226:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.062304:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676260608 00000100:00100000:0.0:1789575585.062320:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676260608 00000100:00100000:0.0:1789575585.062417:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:0.0:1789575585.062428:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10456:x1876505676260608:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575585.062449:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575585.062471:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223836d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ada expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062542:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062558:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062573:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575585.062612:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575585.062639:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062675:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223836d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ada expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062699:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ada expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.062708:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575585.062720:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789575585.062725:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:0.0:1789575585.062799:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676260608:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 371us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.062807:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:1.0:1789575585.074015:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.074177:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676260736 00000100:00100000:0.0:1789575585.074196:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676260736 00000100:00100000:0.0:1789575585.074276:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789575585.074288:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676260736:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575585.074312:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575585.074346:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ae1 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789575585.074419:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaac1a0, blocks: 0x1 00010000:00010000:0.0:1789575585.074446:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1789575585.074452:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575585.074464:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.074494:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.074514:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575585.074610:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676260736:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 324us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.074617:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:2.0:1789575585.077805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.077926:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676260992 00000100:00100000:0.0:1789575585.077936:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676260992 00000100:00100000:0.0:1789575585.078009:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:0.0:1789575585.078019:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676260992:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789575585.078139:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676260992:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 121us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.078146:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:2.0:1789575585.090368:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.090753:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261120 00000100:00100000:0.0:1789575585.090765:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261120 00000100:00100000:0.0:1789575585.090887:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789575585.090900:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:10456:x1876505676261120:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575585.090919:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575585.090938:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ae8 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.091083:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.091094:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575585.091099:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575585.091106:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.091148:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.091163:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 7 pid: 6709 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575585.091187:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699358720:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575585.091288:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575585.099216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575585.099904:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261248 00000100:00100000:1.0:1789575585.099917:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261248 00010000:00010000:1.0:1789575585.099963:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 8 pid: 6709 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.100028:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:1.0:1789575585.100039:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676261248:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575585.100055:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575585.100089:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 8 pid: 6709 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.100105:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 8 pid: 6709 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.100133:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575585.100137:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575585.100158:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.100169:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.100213:0:8471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.100226:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8471:1876505699358848:192.168.202.32@tcp:105: 00000100:00100000:1.0:1789575585.100307:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683029a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789575585.101142:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a223836de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae1 expref: 8 pid: 6709 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575585.101164:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699358720:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575585.101199:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.101211:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076a00, rc 0) 00000100:00100000:0.0:1789575585.101261:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:10456:x1876505676261120:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 10365us (10904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.101270:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789575585.118353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.118439:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8471:1876505699358848:192.168.202.32@tcp:105: 00010000:00010000:3.0:1789575585.118467:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575585.118586:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676261248:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 18547us (19381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575585.118598:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:1.0:1789575585.124973:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261376 00000100:00100000:1.0:1789575585.124998:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261376 00002000:00100000:1.0:1789575585.125065:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e96bc927100 x1876505676261376/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:606/0 lens 504/0 e 0 to 0 dl 1789575596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575585.125087:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc927100 with x1876505676261376 ext(0->8) 00002000:00010000:1.0:1789575585.125093:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc927100 00000100:00100000:1.0:1789575585.125135:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789575585.125146:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676261376:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789575585.127948:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676261376:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 2789us (9591us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789575585.128767:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00002000:00100000:1.0:1789575585.128783:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e96bc927100 x1876505676261376/t4294967302(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:606/0 lens 504/448 e 0 to 0 dl 1789575596 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575585.128795:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc927100 with x1876505676261376 ext(0->8) 00002000:00010000:1.0:1789575585.128884:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc927100 00000100:00100000:2.0:1789575585.143343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.143472:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261504 00000100:00100000:3.0:1789575585.143483:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261504 00000100:00100000:3.0:1789575585.143542:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:3.0:1789575585.143552:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676261504:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789575585.248145:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676261504:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 104581us (104799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575585.248162:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000020:00080000:1.0:1789575585.248209:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789575585.248246:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789575585.248259:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1789575585.248286:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1789575585.248295:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789575585.248301:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1789575585.257115:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699358976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789575585.257199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575585.257588:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699358976 00000100:00100000:1.0:1789575585.257597:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699358976 00000100:00100000:1.0:1789575585.257663:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575585.257673:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699358976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789575585.257840:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789575585.257844:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789575585 00002000:00010000:1.0:1789575585.257846:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789575585.257848:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789575584 -> 1789575585 00002000:00010000:1.0:1789575585.257850:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789575585.257895:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc07e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699358976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (696us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789575585.257902:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789575585.258336:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575585.259261:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.260209:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261632 00000100:00100000:0.0:1789575585.260224:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261632 00000100:00100000:0.0:1789575585.260294:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789575585.260309:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676261632:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789575585.260752:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bc3e1f80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789575585.260763:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699358976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789575585.417588:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676261632:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 157275us (158324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.417602:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000001:00080000:3.0:1789575585.417688:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1789575585.417713:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1789575585.432347:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575585.434874:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676261888 00000100:00100000:2.0:1789575585.434890:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676261888 00000100:00100000:2.0:1789575585.434975:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:2.0:1789575585.434991:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10456:x1876505676261888:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575585.435047:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575585.435099:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223836d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ada expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.435125:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:2.0:1789575585.435130:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575585.435180:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.435467:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.435478:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575585.435748:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099768553 reply state 00000000981b920a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575585.435758:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575585.435865:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10456:x1876505676261888:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 876us (3536us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789575585.435872:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00010000:00010000:1.0:1789575585.441085:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441105:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441124:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441130:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575585.441135:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441144:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441163:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:1.0:1789575585.441167:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575585.441173:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.441179:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223836ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.462760:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.463514:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262016 00000100:00100000:3.0:1789575585.463525:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262016 00000100:00100000:3.0:1789575585.463592:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:3.0:1789575585.463603:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676262016:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789575585.463871:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789575585.463888:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789575585 -> 1789575584 00002000:00010000:3.0:1789575585.463891:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789575582 00002000:00010000:3.0:1789575585.463893:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789575585 -> 1789575584 00002000:00010000:3.0:1789575585.463896:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789575585.463970:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676262016:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 369us (1224us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789575585.463979:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:3.0:1789575585.469080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575585.469525:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262272 00000100:00100000:1.0:1789575585.469534:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262272 00000100:00100000:1.0:1789575585.469587:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:1.0:1789575585.469596:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10456:x1876505676262272:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789575585.469668:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.469686:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 13 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.469714:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.469747:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 13 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.469760:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 13 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.469774:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699359104:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575585.469861:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575585.478797:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.479131:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd92300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699359104:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575585.479163:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.479497:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262400 00000100:00100000:1.0:1789575585.479505:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262400 00010000:00010000:1.0:1789575585.479543:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 14 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.479593:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:1.0:1789575585.479602:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+14:2357:x1876505676262400:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575585.479616:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575585.479623:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 14 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479636:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 14 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479659:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223836b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5acc expref: 14 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479690:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:1.0:1789575585.479695:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479705:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479713:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.479734:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575585.479784:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2357:x1876505676262400:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 183us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575585.479792:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00010000:00010000:0.0:1789575585.479922:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.479939:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.479978:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.479986:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.479992:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.479998:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575585.480002:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.480009:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.480019:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575585.480022:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789575585.480026:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.480032:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223836f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575585.480099:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+12:10456:x1876505676262272:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 10504us (11041us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789575585.480108:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:3.0:1789575585.489519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575585.490260:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262528 00000100:00100000:2.0:1789575585.490271:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262528 00000100:00100000:2.0:1789575585.490431:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789575585.490442:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676262528:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789575585.490487:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.490505:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.490515:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575585.490519:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575585.490524:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.490556:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.490842:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 7 pid: 6708 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575585.490859:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699359232:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575585.491014:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789575585.512206:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.516662:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262656 00000100:00100000:3.0:1789575585.516681:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262656 00010000:00010000:3.0:1789575585.516727:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575585.516773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789575585.516783:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676262656:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575585.516798:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575585.516820:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.516834:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.516877:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575585.516882:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575585.516888:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.516898:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.516923:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575585.517350:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a223836e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ae8 expref: 8 pid: 6708 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575585.517367:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699359232:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575585.518041:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518056:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518063:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518714:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518724:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518733:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518740:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575585.518745:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518771:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518788:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575585.518796:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043652390/0xc45cc82a223836fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575585.518869:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676262528:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 28426us (29356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.518879:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:3.0:1789575585.522683:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676262656:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 5888us (10477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575585.522709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789575585.528101:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575585.528420:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676262912 00000100:00100000:3.0:1789575585.528432:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676262912 00000100:00100000:3.0:1789575585.528487:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:3.0:1789575585.528496:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+12:10456:x1876505676262912:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789575585.528586:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528604:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528616:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528878:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528903:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 13 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528913:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.528951:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 13 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.529092:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 13 pid: 9231 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575585.529108:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699359360:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575585.531591:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968300a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789575585.563600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575585.563796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263040 00000100:00100000:2.0:1789575585.563809:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263040 00010000:00010000:2.0:1789575585.563861:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 14 pid: 9231 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575585.563925:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:2.0:1789575585.563935:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+14:2358:x1876505676263040:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575585.563952:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575585.563960:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 14 pid: 9231 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.563974:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 14 pid: 9231 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.564002:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:2.0:1789575585.564009:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.564021:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.564030:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.564052:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575585.564125:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+14:2358:x1876505676263040:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 191us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575585.564133:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00010000:00010000:1.0:1789575585.564961:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156600/0xc45cc82a223836c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ad3 expref: 13 pid: 9231 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.564979:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699359360:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575585.565004:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.565013:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.565020:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575585.565258:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789575585.565431:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789575585.565480:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789575585.565605:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699359488:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789575585.565682:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575585.565719:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96829dc000 going to sleep for 11 seconds 00000100:00100000:1.0:1789575585.565748:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699359488 00000100:00100000:1.0:1789575585.565755:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699359488 00000100:00100000:1.0:1789575585.565805:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575585.565814:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699359488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789575585.565892:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699359488:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575585.565899:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575585.565935:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789575585.565940:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bc3e1f80, transno 4294967303 00000100:00100000:1.0:1789575585.565955:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699359488:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789575585.566440:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789575585.566500:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699359616:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789575585.566531:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575585.566551:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96829dc600 going to sleep for 11 seconds 00000100:00100000:1.0:1789575585.566754:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699359616 00000100:00100000:1.0:1789575585.566759:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699359616 00000100:00100000:1.0:1789575585.566793:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575585.566800:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699359616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789575585.566979:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5862:x1876505699359616:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (446us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789575585.566996:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575585.567040:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699359616:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789575585.567101:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567118:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567127:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567133:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575585.567138:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567146:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567163:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9687dc9a00) 00010000:00010000:1.0:1789575585.567166:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575585.567172:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567178:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383708 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567217:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567224:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567239:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567244:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575585.567248:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567255:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567264:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:1.0:1789575585.567266:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575585.567269:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567274:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383636 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567294:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567308:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 16 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567317:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567341:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 16 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.567366:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 16 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.567400:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699359744:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575585.567465:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575585.576107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575585.576204:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263168 00000100:00100000:2.0:1789575585.576214:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263168 00010000:00010000:2.0:1789575585.576257:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 17 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575585.576319:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:2.0:1789575585.576330:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+17:2357:x1876505676263168:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575585.576349:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575585.576356:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 17 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.576406:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 17 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.576431:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:2.0:1789575585.576437:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.576449:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.576457:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575585.576476:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575585.576538:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+17:2357:x1876505676263168:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 210us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575585.576558:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00010000:00010000:1.0:1789575585.579366:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ab7 expref: 16 pid: 7184 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.579414:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699359744:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575585.579438:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579448:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579455:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579467:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579474:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579481:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579488:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575585.579502:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579510:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579527:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:1.0:1789575585.579530:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575585.579535:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579553:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a2238370f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579565:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579571:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579577:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579582:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575585.579584:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579590:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579598:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e96831e1100) 00010000:00010000:1.0:1789575585.579600:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789575585.579611:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.579617:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383701 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575585.579852:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10456:x1876505676262912:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 51355us (51759us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789575585.579861:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 83 00000020:00080000:1.0:1789575585.579867:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789575585.580092:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575585.580098:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575585.580143:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789575585.580149:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575585.585450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575585.588787:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263424 00000100:00100000:1.0:1789575585.588810:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263424 00000100:00100000:1.0:1789575585.588918:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789575585.588931:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10456:x1876505676263424:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789575585.590648:0:5866:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789575585.590780:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789575585.590841:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590859:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590871:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590880:0:5866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590886:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590893:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575585.590959:0:5866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789575585.591063:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10456:x1876505676263424:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 2131us (5617us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789575585.591083:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000020:00080000:1.0:1789575585.591089:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789575585.598315:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575585.598334:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.598345:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575585.598350:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.598411:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.598429:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e96831e1d00) 00010000:00010000:3.0:1789575585.598432:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789575585.598437:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.598443:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575585.598470:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575585.598473:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575585.598474:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575585.769714:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575585.947427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.947477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.947517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575585.947562:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263808 00000100:00100000:0.0:1789575585.947573:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263808 00000100:00100000:0.0:1789575585.947636:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:0.0:1789575585.947676:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676263808:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575585.947762:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2355:x1876505676263808:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575585.947770:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00080000:0.0:1789575585.947793:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575585.948250:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263552 00000100:00100000:2.0:1789575585.948258:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263552 00000100:00100000:2.0:1789575585.948293:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:2.0:1789575585.948301:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676263552:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575585.948361:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676263552:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 61us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575585.949732:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:3.0:1789575585.951015:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676263680 00000100:00100000:3.0:1789575585.951026:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676263680 00000100:00100000:3.0:1789575585.951283:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789575585.951295:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676263680:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575585.951433:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676263680:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 140us (4018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575585.951442:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00080000:2.0:1789575585.951625:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789575586.022041:0:12031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789575586.022052:0:12031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789575586.022118:0:12031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789575586.022125:0:12031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789575586.219297:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575586.219409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575586.219650:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699359872 00000100:00100000:2.0:1789575586.219660:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699359872 00000100:00100000:2.0:1789575586.219738:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789575586.219748:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699359872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575586.219786:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575586.219849:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699359872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575586.219857:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789575586.219903:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699359872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575586.221083:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575586.275525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.275558:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676264064 00000100:00100000:0.0:1789575586.275574:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676264064 00000100:00100000:0.0:1789575586.275633:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789575586.275642:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+17:10476:x1876505676264064:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575586.275668:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575586.275689:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238371d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5aef expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.275791:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383724 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.275806:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383724 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.275819:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383724 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575586.275830:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789575586.275947:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238371d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aef expref: 20 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.275964:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aef expref: 19 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789575586.277550:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789575586.279766:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575586.279771:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789575586.279775:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077c00, rc 0) 00000100:00100000:0.0:1789575586.279866:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10476:x1876505676264064:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4219us (4345us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789575586.279877:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789575586.289224:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575586.298976:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676264192 00000100:00100000:3.0:1789575586.298992:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676264192 00000100:00100000:3.0:1789575586.299054:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789575586.299074:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10476:x1876505676264192:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:3.0:1789575586.299154:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299184:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299197:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299214:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299222:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299229:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299477:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299486:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299493:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575586.299533:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299545:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299552:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299569:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299575:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575586.299579:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299587:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299599:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575586.299602:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575586.299607:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299612:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383732 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299625:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299631:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299636:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299640:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575586.299643:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299658:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299665:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687bd8b00) 00010000:00010000:3.0:1789575586.299667:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575586.299670:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299676:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299690:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299696:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299710:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299716:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575586.299718:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299724:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299732:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575586.299734:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575586.299737:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.299753:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575586.301518:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10476:x1876505676264192:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 2444us (12295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575586.301531:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789575586.374914:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.375038:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676264448 00000100:00100000:0.0:1789575586.375051:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676264448 00000100:00100000:0.0:1789575586.375128:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789575586.375138:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+19:10479:x1876505676264448:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575586.375159:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575586.375181:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5af6 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375266:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375282:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375294:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375309:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375316:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.375323:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376168:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376195:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376204:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575586.376215:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789575586.376319:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376327:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376344:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376350:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.376354:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376686:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376701:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575586.376704:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.376710:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376716:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238374e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376733:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376740:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376746:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376751:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.376754:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376772:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376781:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9f00) 00010000:00010000:2.0:1789575586.376784:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.376787:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376793:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376842:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 22 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376857:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 21 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.376865:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575586.376867:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575586.376869:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:2.0:1789575586.376945:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10479:x1876505676264448:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1807us (2040us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789575586.376954:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:3.0:1789575586.384350:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.385749:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676264576 00000100:00100000:0.0:1789575586.385766:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676264576 00000100:00100000:0.0:1789575586.385850:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789575586.385861:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10479:x1876505676264576:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789575586.385962:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.385982:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.385995:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386024:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386031:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386038:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386045:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575586.386050:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386057:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386083:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:0.0:1789575586.386086:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575586.386092:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.386098:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a2238376a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575586.386197:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10479:x1876505676264576:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 336us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575586.386206:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789575586.392429:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575586.392544:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676264832 00000100:00100000:1.0:1789575586.392554:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676264832 00000100:00100000:1.0:1789575586.392611:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789575586.392621:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690788c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10479:x1876505676264832:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789575586.392837:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690788c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+22:10479:x1876505676264832:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 217us (418us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789575586.392844:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789575586.472341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575586.478041:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265088 00000100:00100000:1.0:1789575586.478071:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265088 00000100:00100000:2.0:1789575586.478445:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:2.0:1789575586.478461:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+22:10006:x1876505676265088:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575586.478496:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575586.478523:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383771 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5afd expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.478674:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.478690:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 23 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.478714:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.478762:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 23 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.478778:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 23 pid: 5864 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575586.478797:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699360000:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575586.478941:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968133ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575586.483836:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575586.484737:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699360000:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575586.484772:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575586.488115:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265216 00000100:00100000:1.0:1789575586.488137:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265216 00010000:00010000:1.0:1789575586.488215:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 24 pid: 5864 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575586.488300:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:1.0:1789575586.488313:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+24:2357:x1876505676265216:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575586.488333:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575586.488342:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 24 pid: 5864 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488357:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 24 pid: 5864 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488423:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238375c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5af6 expref: 24 pid: 5864 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488445:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:1.0:1789575586.488462:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488474:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488483:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.488518:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575586.488738:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.488748:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575586.488771:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789575586.488944:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383771 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.488960:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575586.488967:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:3.0:1789575586.488970:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789575586.488980:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9800, rc 0) 00000100:00100000:1.0:1789575586.493171:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+24:2357:x1876505676265216:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 4840us (9328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575586.493192:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:3.0:1789575586.499122:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+23:10006:x1876505676265088:12345-192.168.202.32@tcp:101:bash.0 Request processed in 20643us (26774us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789575586.499140:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:2.0:1789575586.505720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.505986:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265472 00000100:00100000:0.0:1789575586.505998:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265472 00000100:00100000:0.0:1789575586.506107:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:0.0:1789575586.506118:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+23:10006:x1876505676265472:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:0.0:1789575586.506668:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.506687:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.506700:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575586.506759:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789575586.506796:0:5864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d658e92c reply state 000000002cda85bb transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575586.506805:0:5864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789575586.506974:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789575586.507116:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10006:x1876505676265472:12345-192.168.202.32@tcp:36:bash.0 Request processed in 998us (1407us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789575586.507125:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 89 00000020:00080000:0.0:1789575586.507131:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789575586.510679:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575586.510694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:1.0:1789575586.510704:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.510712:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.510718:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575586.510728:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.510736:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.510756:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:1.0:1789575586.510760:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575586.510766:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575586.510774:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383786 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575586.511940:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265600 00000100:00100000:2.0:1789575586.511954:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265600 00000100:00100000:2.0:1789575586.512020:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:2.0:1789575586.512031:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10006:x1876505676265600:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575586.512068:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575586.512088:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238378d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b04 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.512173:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238378d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b04 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.512191:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238378d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b04 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.512213:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575586.512216:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789575586.512219:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9000, rc 0) 00000100:00100000:2.0:1789575586.512283:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10006:x1876505676265600:12345-192.168.202.32@tcp:101:bash.0 Request processed in 253us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575586.512290:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:0.0:1789575586.515779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575586.515941:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265728 00000100:00100000:2.0:1789575586.515952:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265728 00000100:00100000:2.0:1789575586.516066:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789575586.516079:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:10006:x1876505676265728:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575586.516099:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575586.516123:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b0b expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575586.516156:0:9232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaac1a0, atime: 0x6aaac19e, ctime: 0x6aaac1a0, blocks: 0xb 00010000:00010000:2.0:1789575586.516182:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1789575586.516187:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575586.516196:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.516243:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.516256:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8a00, rc 0) 00000100:00100000:2.0:1789575586.516328:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:10006:x1876505676265728:12345-192.168.202.32@tcp:101:bash.0 Request processed in 251us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575586.516336:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00080000:1.0:1789575586.518450:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575586.519682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.519833:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265856 00000100:00100000:0.0:1789575586.519958:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265856 00002000:00010000:0.0:1789575586.519999:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789575586.520004:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc925f80 with x1876505676265856 ext(0->18446744073709551615) 00002000:00010000:0.0:1789575586.520017:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc925f80. 00000100:00100000:0.0:1789575586.520054:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789575586.520075:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676265856:12345-192.168.202.32@tcp:10:bash.0 00002000:00010000:0.0:1789575586.520366:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789575586.520526:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789575584 -> 1789575586 00002000:00010000:0.0:1789575586.520529:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789575582 -> 1789575582 00002000:00010000:0.0:1789575586.520540:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789575584 -> 1789575586 00002000:00010000:0.0:1789575586.520542:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789575586.520603:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676265856:12345-192.168.202.32@tcp:10:bash.0 Request processed in 530us (926us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789575586.520611:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00002000:00010000:0.0:1789575586.520615:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789575586.520617:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc925f80 with x1876505676265856 ext(0->18446744073709551615) 00002000:00010000:0.0:1789575586.520623:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc925f80. 00000100:00100000:3.0:1789575586.643355:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.643528:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676265984 00000100:00100000:0.0:1789575586.643543:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676265984 00000100:00100000:0.0:1789575586.643687:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:0.0:1789575586.643700:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10493:x1876505676265984:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:0.0:1789575586.643790:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.643808:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.643845:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.643865:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.643873:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.643880:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648124:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648145:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648158:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575586.648210:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648222:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648229:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648236:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648257:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.648262:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648269:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648282:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575586.648286:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.648291:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648296:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238379b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648310:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648316:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648323:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648328:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.648331:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648336:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648354:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9300) 00010000:00010000:2.0:1789575586.648357:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.648528:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648536:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648555:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648561:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648567:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648572:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.648575:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648581:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648589:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575586.648591:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.648594:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.648599:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575586.648722:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10493:x1876505676265984:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 5019us (5380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575586.648731:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:1.0:1789575586.745671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.745776:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676266240 00000100:00100000:0.0:1789575586.745787:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676266240 00000100:00100000:0.0:1789575586.745847:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:0.0:1789575586.745858:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+27:10496:x1876505676266240:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575586.745880:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575586.745902:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b12 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.745977:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.745992:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746002:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746016:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746036:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746043:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746333:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223837c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746343:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223837c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746351:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223837c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575586.746361:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789575586.746517:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746525:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746533:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746539:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575586.746550:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746558:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746582:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575586.746585:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575586.746591:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746598:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a223837b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746612:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746618:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746624:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746629:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575586.746632:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746638:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746645:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575586.746647:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575586.746650:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746656:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223837be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746931:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b12 expref: 30 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746949:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223837c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b12 expref: 29 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.746956:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:0.0:1789575586.746958:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789575586.746961:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575586.747043:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10496:x1876505676266240:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1185us (1382us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789575586.747051:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:3.0:1789575586.754050:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.754154:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676266368 00000100:00100000:0.0:1789575586.754168:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676266368 00000100:00100000:0.0:1789575586.754228:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:0.0:1789575586.754236:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10496:x1876505676266368:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789575586.754310:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.754330:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.754339:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.754412:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.754452:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 29 pid: 5862 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575586.754469:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699360128:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575586.754573:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9684d72c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575586.758277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575586.758486:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676266624 00000100:00100000:1.0:1789575586.758508:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676266624 00000100:00100000:1.0:1789575586.758588:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789575586.758599:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+30:5598:x1876505676266624:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789575586.759154:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+31:5598:x1876505676266624:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 555us (891us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789575586.759180:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789575586.764313:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699360128:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575586.764420:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575586.767463:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575586.767780:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676266752 00000100:00100000:2.0:1789575586.767798:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676266752 00010000:00010000:2.0:1789575586.767849:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 31 pid: 5862 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575586.767893:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789575586.767904:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+31:2357:x1876505676266752:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575586.767922:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575586.767929:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 31 pid: 5862 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.767943:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 31 pid: 5862 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.767971:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383778 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5afd expref: 31 pid: 5862 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.767991:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575586.767998:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.768009:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.768037:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.768089:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575586.768168:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+30:2357:x1876505676266752:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 264us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575586.768177:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00010000:00010000:0.0:1789575586.768910:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768923:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768959:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768967:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768974:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768981:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575586.768986:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.768996:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.769018:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:0.0:1789575586.769021:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575586.769027:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575586.769034:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a223837d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575586.769104:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10496:x1876505676266368:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 14866us (15067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575586.769113:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:2.0:1789575586.774785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575586.775003:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676267008 00000100:00100000:3.0:1789575586.775023:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676267008 00000100:00100000:3.0:1789575586.775122:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575586.775133:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+29:10496:x1876505676267008:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575586.775553:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+30:10496:x1876505676267008:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 420us (780us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789575586.775562:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00010000:00010000:1.0:1789575586.793973:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575586.943362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575586.943560:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676267264 00000100:00100000:2.0:1789575586.943575:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676267264 00000100:00100000:2.0:1789575586.943642:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:2.0:1789575586.943655:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+30:10507:x1876505676267264:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789575586.943701:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575586.943728:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223837da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b19 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943828:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943851:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943869:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943887:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943895:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.943920:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.944504:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.944516:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.944778:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575586.944795:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789575586.945336:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945346:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945353:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945360:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.945364:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945417:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945437:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575586.945442:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.945465:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945471:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a223837e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945489:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945495:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945500:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945506:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575586.945509:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945514:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.945522:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9683773700) 00010000:00010000:2.0:1789575586.945524:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575586.946287:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.946303:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223837e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.946450:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223837da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b19 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.946490:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b19 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575586.946498:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575586.946501:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575586.946504:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:2.0:1789575586.948070:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10507:x1876505676267264:12345-192.168.202.32@tcp:101:cat.0 Request processed in 4394us (4702us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789575586.948096:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789575586.958780:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575586.958847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575586.959009:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676267392 00000100:00100000:1.0:1789575586.959026:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676267392 00002000:00100000:1.0:1789575586.959115:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff8e95876aa300 x1876505676267392/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:607/0 lens 496/0 e 0 to 0 dl 1789575597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575586.959126:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e95876aa300 with x1876505676267392 ext(0->7) 00002000:00010000:1.0:1789575586.959133:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e95876aa300 00000100:00100000:1.0:1789575586.959177:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789575586.959189:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2355:x1876505676267392:12345-192.168.202.32@tcp:4:cat.0 00000100:00100000:3.0:1789575586.960260:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676267520 00000100:00100000:3.0:1789575586.960275:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676267520 00000100:00100000:3.0:1789575586.960332:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789575586.960343:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2355:x1876505676267520:12345-192.168.202.32@tcp:16:kworker.0 00000100:00100000:1.0:1789575586.960955:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2355:x1876505676267392:12345-192.168.202.32@tcp:4:cat.0 Request processed in 1762us (2186us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789575586.960966:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00002000:00100000:1.0:1789575586.960978:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff8e95876aa300 x1876505676267392/t4294967307(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:607/0 lens 496/448 e 0 to 0 dl 1789575597 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575586.960988:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e95876aa300 with x1876505676267392 ext(0->7) 00002000:00010000:1.0:1789575586.960994:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e95876aa300 00000100:00100000:2.0:1789575586.972512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575586.973551:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676267776 00000100:00100000:1.0:1789575586.973572:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676267776 00000100:00100000:1.0:1789575586.973648:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:1.0:1789575586.973661:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10507:x1876505676267776:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:1.0:1789575586.974173:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+33:10507:x1876505676267776:12345-192.168.202.32@tcp:35:cat.0 Request processed in 513us (1675us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789575586.974197:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789575587.030104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.030267:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268032 00000100:00100000:3.0:1789575587.030281:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268032 00000100:00100000:3.0:1789575587.030368:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:3.0:1789575587.030998:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+33:10508:x1876505676268032:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:3.0:1789575587.031209:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789575587.031249:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223837ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b19 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.031305:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a223837c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b12 expref: 32 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.031322:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a2238378d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b04 expref: 31 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.031334:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:3.0:1789575587.031351:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575587.031954:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.031974:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.031987:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032005:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032012:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032019:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032351:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032362:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.032402:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575587.039896:0:9231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789575587.039931:0:9231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399126558271ns, next at 400126550205ns, rc = 0 00010000:00010000:3.0:1789575587.040921:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.040949:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.040966:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.040977:0:9231:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.040985:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.040991:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.041025:0:9231:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575587.041074:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.042483:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575587.042497:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.042570:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.042576:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.050936:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575587.050956:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.050978:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.051003:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:2.0:1789575587.051007:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789575587.051015:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.051022:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383812 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.051091:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575587.051094:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575587.051097:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575587.052973:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575587.052991:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053006:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053024:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575587.053028:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789575587.053033:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053041:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a2238380b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053093:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053101:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053108:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053113:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575587.053116:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053122:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053150:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575587.053152:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575587.053155:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.053160:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223837fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575587.053172:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f1c69be reply state 000000009cbac59f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.053183:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575587.053334:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+32:10508:x1876505676268032:12345-192.168.202.32@tcp:36:rm.0 Request processed in 22335us (23249us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789575587.053344:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00010000:00010000:2.0:1789575587.070157:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070188:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070198:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070206:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575587.070212:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070232:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070255:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687bd8b00) 00010000:00010000:2.0:1789575587.070259:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575587.070266:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.070274:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383804 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575587.089125:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1789575587.089150:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789575587.089161:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1789575587.097125:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2355:x1876505676267520:12345-192.168.202.32@tcp:16:kworker.0 Request processed in 136763us (138257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.097142:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:1.0:1789575587.229484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575587.229653:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268288 00000100:00100000:0.0:1789575587.229668:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268288 00000100:00100000:0.0:1789575587.229752:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:0.0:1789575587.229765:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+31:10514:x1876505676268288:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789575587.229798:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575587.229841:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383819 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b20 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230020:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230041:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230066:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230106:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230115:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.230122:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575587.236951:0:7184:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789575587.237316:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237343:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237360:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237461:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237471:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237479:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237486:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575587.237492:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237524:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237541:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575587.237544:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575587.237551:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237558:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383820 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575587.237576:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd213049 reply state 000000004efd5e1b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575587.237586:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789575587.237638:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 34 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237659:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 33 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.237667:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575587.237670:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575587.237672:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575587.237795:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+34:10514:x1876505676268288:12345-192.168.202.32@tcp:101:bash.0 Request processed in 8032us (8333us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789575587.237807:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:1.0:1789575587.241300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699360640:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241442:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241518:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789575587.241525:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699360256:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241582:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699360768:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241605:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241631:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699360512:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241677:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789575587.241684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699360384:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241724:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699360896:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575587.241779:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360256 00000100:00100000:1.0:1789575587.241789:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360256 00000100:00100000:1.0:1789575587.241862:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789575587.241872:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699360256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.241938:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699360256:12345-0@lo:400:kworker.0 Request processed in 66us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.241945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789575587.242184:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360768 00000100:00100000:1.0:1789575587.242205:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360768 00000100:00100000:1.0:1789575587.242248:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360512 00000100:00100000:1.0:1789575587.242251:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360512 00000100:00100000:1.0:1789575587.242274:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360384 00000100:00100000:1.0:1789575587.242277:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360384 00000100:00100000:1.0:1789575587.242291:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789575587.242297:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699360768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.242334:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699360768:12345-0@lo:400:kworker.0 Request processed in 37us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.242340:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789575587.242353:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789575587.242359:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699360512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.242522:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789575587.242533:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699360384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.242578:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699360384:12345-0@lo:400:kworker.0 Request processed in 48us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.242584:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1789575587.242907:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575587.242938:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360640 00000100:00100000:3.0:1789575587.242943:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360640 00000100:00100000:3.0:1789575587.242987:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699360896 00000100:00100000:3.0:1789575587.242991:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699360896 00000100:00100000:3.0:1789575587.243018:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789575587.243024:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243073:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699360640:12345-0@lo:400:kworker.0 Request processed in 48us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.243078:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789575587.243091:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789575587.243097:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699360896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243121:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699360896:12345-0@lo:400:kworker.0 Request processed in 25us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.243126:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789575587.243145:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575587.243185:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699360256:0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243206:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699360768:0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243218:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699360640:0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243600:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699360384:0@lo:400:kworker.0 00000100:00100000:3.0:1789575587.243614:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789575587.243620:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1789575587.243639:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699360896:0@lo:400:kworker.0 00000100:00100000:1.0:1789575587.243779:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699360512:12345-0@lo:400:kworker.0 Request processed in 1418us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.243788:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789575587.244354:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699360512:0@lo:400:kworker.0 00010000:00010000:1.0:1789575587.251030:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251061:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251071:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251079:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575587.251086:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251094:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251140:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687dc9500) 00010000:00010000:1.0:1789575587.251143:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575587.251149:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.251155:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575587.253281:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.254930:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268416 00000100:00100000:3.0:1789575587.254966:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268416 00000100:00100000:3.0:1789575587.255079:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789575587.255091:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676268416:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575587.255118:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575587.255146:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b27 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575587.255189:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575587.255218:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1789575587.255222:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575587.255233:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.255257:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.255272:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575587.255357:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676268416:12345-192.168.202.32@tcp:101:bash.0 Request processed in 269us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.255365:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00080000:0.0:1789575587.255841:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575587.284571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.285686:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268544 00000100:00100000:3.0:1789575587.285706:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268544 00000100:00100000:3.0:1789575587.285792:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789575587.285805:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10514:x1876505676268544:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575587.285833:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575587.285860:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b2e expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.285916:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 9 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.285927:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575587.285932:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575587.285938:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.286183:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 9 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.286200:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 9 pid: 6708 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.286217:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1876505699361024:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575587.286857:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690f94600 going to sleep for 11 seconds 00000100:00100000:0.0:1789575587.295614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575587.297201:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268672 00000100:00100000:2.0:1789575587.297219:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268672 00010000:00010000:2.0:1789575587.297292:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 10 pid: 6708 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575587.297429:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789575587.297442:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676268672:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575587.297466:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575587.297503:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 10 pid: 6708 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.297521:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 10 pid: 6708 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.299830:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575587.299836:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575587.299854:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.299870:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.299944:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575587.299966:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1876505699361152:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789575587.300121:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688b2b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789575587.300636:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ed9862/0xc45cc82a2238383c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b27 expref: 10 pid: 6708 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.300657:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1876505699361024:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575587.300700:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.300713:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1200, rc 0) 00000100:00100000:3.0:1789575587.300769:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10514:x1876505676268544:12345-192.168.202.32@tcp:101:bash.0 Request processed in 14967us (16214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.300778:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789575587.304557:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1876505699361152:192.168.202.32@tcp:105: 00010000:00010000:3.0:1789575587.304594:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575587.304675:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676268672:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 7234us (9077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.304688:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789575587.311045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575587.311320:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676268928 00000100:00100000:1.0:1789575587.311335:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676268928 00000100:00100000:1.0:1789575587.311457:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789575587.311470:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+33:10514:x1876505676268928:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:1.0:1789575587.312196:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+34:10514:x1876505676268928:12345-192.168.202.32@tcp:35:bash.0 Request processed in 726us (1163us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789575587.312206:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789575587.605075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575587.605245:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269056 00000100:00100000:1.0:1789575587.605257:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269056 00000100:00100000:1.0:1789575587.605343:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:1.0:1789575587.605354:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+34:10530:x1876505676269056:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575587.605427:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575587.605455:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238384a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b35 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605540:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605577:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605591:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575587.605636:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789575587.605640:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575587.605661:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605691:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238384a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b35 expref: 36 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605711:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b35 expref: 35 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.605721:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:1.0:1789575587.605725:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789575587.605729:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:1.0:1789575587.605805:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10530:x1876505676269056:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 452us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.605811:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:2.0:1789575587.614587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.614707:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269312 00000100:00100000:3.0:1789575587.614722:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269312 00000100:00100000:3.0:1789575587.614813:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:3.0:1789575587.614829:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:10530:x1876505676269312:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575587.614865:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575587.614897:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b3c expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.615061:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238385f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.615081:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238385f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.615098:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238385f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575587.615114:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789575587.615309:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b3c expref: 38 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.615357:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238385f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b3c expref: 37 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.615366:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:3.0:1789575587.615405:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575587.615410:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575587.615498:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+37:10530:x1876505676269312:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 673us (931us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789575587.615506:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:0.0:1789575587.629447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575587.635706:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269568 00000100:00100000:2.0:1789575587.635757:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269568 00000100:00100000:2.0:1789575587.635869:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:2.0:1789575587.635883:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+37:10530:x1876505676269568:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575587.635920:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575587.635953:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238386d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b43 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.636122:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.636143:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.636160:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575587.636179:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789575587.636368:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a2238386d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b43 expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.636442:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b43 expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.636452:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:2.0:1789575587.636455:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789575587.636460:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575587.636565:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+39:10530:x1876505676269568:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 684us (7195us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789575587.636574:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:2.0:1789575587.646916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575587.647087:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269696 00000100:00100000:0.0:1789575587.647102:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269696 00000100:00100000:0.0:1789575587.647211:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789575587.647224:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+39:2358:x1876505676269696:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575587.647245:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575587.647278:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a2238385f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b3c expref: 39 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.647306:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575587.647312:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575587.647421:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+38:2358:x1876505676269696:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 199us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575587.647428:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575587.651693:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575587.652276:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269824 00000100:00100000:0.0:1789575587.652296:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269824 00000100:00100000:0.0:1789575587.652361:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789575587.652420:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676269824:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:0.0:1789575587.652482:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.652508:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.652545:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575587.652551:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575587.652557:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.652623:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.652646:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 8 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575587.652673:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6708:1876505699361280:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575587.652873:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575587.655442:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6708:1876505699361280:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575587.655484:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.660697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575587.672508:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676269952 00000100:00100000:1.0:1789575587.672533:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676269952 00002000:00100000:1.0:1789575587.672619:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e96bb5b5f80 x1876505676269952/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:608/0 lens 504/0 e 0 to 0 dl 1789575598 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575587.672632:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bb5b5f80 with x1876505676269952 ext(0->8) 00010000:00010000:1.0:1789575587.672665:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 9 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.672688:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 9 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789575587.672697:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bb5b5f80 00000100:00100000:1.0:1789575587.672747:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789575587.672759:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676269952:12345-192.168.202.32@tcp:4:lfs.0 00000100:00100000:1.0:1789575587.678586:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2357:x1876505676269952:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 5813us (17890us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789575587.678605:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00002000:00100000:1.0:1789575587.678622:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e96bb5b5f80 x1876505676269952/t4294967302(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:608/0 lens 504/448 e 0 to 0 dl 1789575598 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575587.678634:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bb5b5f80 with x1876505676269952 ext(0->8) 00010000:00010000:1.0:1789575587.678647:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.678677:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789575587.678685:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bb5b5f80 00000100:00100000:1.0:1789575587.683057:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575587.683929:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270080 00000100:00100000:2.0:1789575587.683944:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270080 00010000:00010000:2.0:1789575587.684004:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575587.684077:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789575587.684093:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2358:x1876505676270080:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575587.684117:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789575587.684148:0:5848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789575587.684151:0:5848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789575587 00002000:00010000:2.0:1789575587.684154:0:5848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789575587 00002000:00010000:2.0:1789575587.684156:0:5848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789575587 00010000:00010000:2.0:1789575587.684164:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.684181:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.684211:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000876b112f/0xc45cc82a22383843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b2e expref: 11 pid: 6706 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.684232:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575587.684237:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575587.684244:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.684291:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575587.684448:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575587.684520:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676270080:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 430us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575587.684529:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00010000:00010000:0.0:1789575587.701554:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701582:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701636:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701671:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701682:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701690:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575587.701695:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701707:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701733:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.701742:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007abbc84f/0xc45cc82a22383882 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575587.701898:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676269824:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 49476us (50213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575587.701911:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:1.0:1789575587.705784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.706509:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270336 00000100:00100000:3.0:1789575587.706523:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270336 00000100:00100000:3.0:1789575587.706603:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789575587.706617:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690788850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+38:10530:x1876505676270336:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:3.0:1789575587.706699:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b43 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575587.707039:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1789575587.707101:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789575587.708998:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1789575587.709106:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.709131:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 42 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.709163:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.709216:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 42 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.709235:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 42 pid: 7184 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.709253:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5865:1876505699361408:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575587.710672:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575587.733801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575587.734501:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270464 00000100:00100000:0.0:1789575587.734517:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270464 00010000:00010000:0.0:1789575587.734573:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 43 pid: 7184 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575587.734663:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789575587.734675:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+43:2357:x1876505676270464:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575587.734695:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575587.734706:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 43 pid: 7184 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.734722:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 43 pid: 7184 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.734749:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575587.734755:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.734767:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.734776:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.734805:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575587.734896:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+43:2357:x1876505676270464:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 223us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575587.734905:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00010000:00010000:3.0:1789575587.744074:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238382e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b20 expref: 42 pid: 7184 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575587.744115:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5865:1876505699361408:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575587.744150:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.744163:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.744170:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575587.744359:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789575587.746024:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789575587.746203:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699361536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789575587.746315:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575587.746365:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690f94240 going to sleep for 11 seconds 00000100:00100000:0.0:1789575587.746576:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699361536 00000100:00100000:0.0:1789575587.746587:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699361536 00000100:00100000:0.0:1789575587.746659:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789575587.746671:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1876505699361536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789575587.746777:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1876505699361536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575587.746784:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789575587.748250:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699361536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789575587.750572:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789575587.750713:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699361664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789575587.750804:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575587.760431:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575587.771843:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699361664 00000100:00100000:0.0:1789575587.771873:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699361664 00000100:00100000:1.0:1789575587.772119:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575587.772136:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1876505699361664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789575587.772692:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5865:x1876505699361664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 559us (21886us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789575587.772702:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575587.779175:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5865:1876505699361664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789575587.779343:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789575587.779511:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779525:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779535:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779542:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575587.779548:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779557:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779582:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575587.779586:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789575587.779593:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575587.779601:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383889 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575587.779979:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789575587.780142:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789575587.780159:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399866786730ns, next at 400866782835ns, rc = 0 00000001:00080000:0.0:1789575587.780167:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789575587.780214:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687dc9d00) 00010000:00010000:0.0:1789575587.780217:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789575587.780226:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383874 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b43 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575587.780450:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690788850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+45:10530:x1876505676270336:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 73834us (74680us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789575587.780462:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000020:00080000:0.0:1789575587.780470:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789575587.784969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575587.791008:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575587.791043:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575587.791157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575587.791348:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270592 00000100:00100000:3.0:1789575587.791360:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270592 00000100:00100000:3.0:1789575587.791448:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:3.0:1789575587.791459:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:10530:x1876505676270592:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575587.791491:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575587.791522:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b4a expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.791602:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b4a expref: 46 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.791621:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b4a expref: 46 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575587.791643:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575587.791647:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575587.791652:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575587.791719:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+46:10530:x1876505676270592:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 261us (6766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575587.791728:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:1.0:1789575587.796095:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699361792 00000100:00100000:1.0:1789575587.796121:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699361792 00000100:00100000:1.0:1789575587.796201:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789575587.796212:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699361792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789575587.796258:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789575587.796405:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699361792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (5215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.796412:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789575587.796487:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699361792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575587.797723:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575587.797760:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270848 00000100:00100000:3.0:1789575587.797768:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270848 00000100:00100000:3.0:1789575587.797828:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:3.0:1789575587.797837:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+46:10530:x1876505676270848:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575587.798116:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10530:x1876505676270848:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 278us (398us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789575587.798125:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00010000:00010000:1.0:1789575587.816548:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789575587.895152:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1789575587.895178:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789575587.895189:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1789575587.971213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575587.975983:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676270976 00000100:00100000:1.0:1789575587.976009:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676270976 00000100:00100000:1.0:1789575587.976142:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:1.0:1789575587.976158:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10540:x1876505676270976:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:1.0:1789575587.976290:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976314:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976331:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976351:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976440:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976448:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976586:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976596:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976603:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789575587.976657:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976672:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976679:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976687:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976693:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575587.976699:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976708:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976732:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:1.0:1789575587.976736:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575587.976742:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976749:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976766:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976773:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976779:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976795:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575587.976798:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976804:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.976812:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e96831e1100) 00010000:00010000:1.0:1789575587.978225:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575587.978237:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978248:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a2238389e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978299:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978307:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978314:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978320:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575587.978324:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978331:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978345:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575587.978348:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575587.978352:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575587.978358:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575587.978503:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10540:x1876505676270976:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 2345us (7303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575587.978515:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:3.0:1789575588.059057:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.060168:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676271232 00000100:00100000:1.0:1789575588.060187:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676271232 00000100:00100000:1.0:1789575588.060302:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:1.0:1789575588.060334:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+47:10543:x1876505676271232:12345-192.168.202.32@tcp:101:lfs.0 00000100:00080000:0.0:1789575588.060347:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789575588.060417:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575588.060446:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b51 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060556:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060575:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060590:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060608:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060617:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060625:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060802:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223838c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060811:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223838c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060819:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223838c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575588.060843:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789575588.060981:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060990:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.060997:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061003:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575588.061009:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061018:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061032:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:1.0:1789575588.061036:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575588.061042:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061058:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061078:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061084:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061100:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061106:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575588.061108:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061115:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061123:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e96831e1100) 00010000:00010000:1.0:1789575588.061126:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575588.061129:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061135:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061187:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223838ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b51 expref: 50 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061203:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223838c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b51 expref: 49 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.061211:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575588.061213:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575588.061216:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:1.0:1789575588.061317:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10543:x1876505676271232:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 986us (2282us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789575588.061335:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:3.0:1789575588.065755:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.065855:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676271360 00000100:00100000:0.0:1789575588.065868:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676271360 00000100:00100000:0.0:1789575588.065944:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:0.0:1789575588.065957:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10543:x1876505676271360:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789575588.066060:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066082:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066117:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066152:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066159:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066166:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066171:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575588.066176:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066183:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066197:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575588.066200:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575588.066206:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.066212:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a223838cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.066314:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10543:x1876505676271360:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 358us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575588.066321:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:2.0:1789575588.089201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.089407:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676271616 00000100:00100000:3.0:1789575588.089421:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676271616 00000100:00100000:3.0:1789575588.089538:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:3.0:1789575588.089551:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:10543:x1876505676271616:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575588.090074:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+50:10543:x1876505676271616:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 523us (887us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789575588.090083:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:3.0:1789575588.231612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.231800:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676271872 00000100:00100000:1.0:1789575588.231816:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676271872 00000100:00100000:1.0:1789575588.231907:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 104 00000100:00100000:1.0:1789575588.231919:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+50:10553:x1876505676271872:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789575588.231952:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575588.231956:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789575588.231990:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b35 expref: 50 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232017:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:1.0:1789575588.232024:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575588.232069:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b58 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232205:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232222:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232233:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575588.232245:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789575588.232484:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223838d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b58 expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232530:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b58 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.232539:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575588.232543:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575588.232545:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575588.232637:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10553:x1876505676271872:12345-192.168.202.32@tcp:101:bash.0 Request processed in 719us (1041us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789575588.232646:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 104 00000100:00100000:1.0:1789575588.236831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.236979:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676272128 00000100:00100000:3.0:1789575588.236995:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676272128 00000100:00100000:3.0:1789575588.237138:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:3.0:1789575588.237152:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10553:x1876505676272128:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789575588.237246:0:5864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789575588.237284:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223838dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b58 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.237348:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223838c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b51 expref: 50 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.237552:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575588.237561:0:5864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575588.237912:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.237933:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.237946:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575588.238016:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789575588.238062:0:5864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9d86757 reply state 000000008dd7d68b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575588.238073:0:5864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575588.238240:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10553:x1876505676272128:12345-192.168.202.32@tcp:36:bash.0 Request processed in 1088us (1425us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789575588.238250:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00000020:00080000:3.0:1789575588.238256:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789575588.245799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:1.0:1789575588.245897:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.245915:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.245925:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.245932:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575588.245939:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.245949:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.245970:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00000100:00100000:3.0:1789575588.245972:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676272256 00010000:00010000:1.0:1789575588.245973:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789575588.245986:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676272256 00010000:00010000:1.0:1789575588.246014:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.246021:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a223838eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575588.246078:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:3.0:1789575588.246093:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:10553:x1876505676272256:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575588.246130:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.246164:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223838f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b5f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246285:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246302:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246315:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575588.246355:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789575588.246360:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575588.246409:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246442:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a223838f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246459:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.246468:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575588.246471:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575588.246473:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1200, rc 0) 00000100:00100000:3.0:1789575588.246560:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10553:x1876505676272256:12345-192.168.202.32@tcp:101:bash.0 Request processed in 471us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.246568:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:2.0:1789575588.251890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.252009:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676272512 00000100:00100000:0.0:1789575588.252060:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676272512 00000100:00100000:0.0:1789575588.252192:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789575588.252207:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:10553:x1876505676272512:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:0.0:1789575588.252707:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10553:x1876505676272512:12345-192.168.202.32@tcp:35:bash.0 Request processed in 502us (837us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789575588.252718:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789575588.330645:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.330886:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676272640 00000100:00100000:3.0:1789575588.330920:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676272640 00000100:00100000:3.0:1789575588.331001:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:3.0:1789575588.331013:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:10558:x1876505676272640:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575588.331058:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.331090:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b66 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331188:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331207:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331221:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575588.331269:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789575588.331272:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575588.331294:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331321:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b66 expref: 55 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331340:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b66 expref: 54 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.331347:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575588.331350:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575588.331353:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575588.331498:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676272640:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 487us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.331507:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:2.0:1789575588.337204:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.337362:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676272768 00000100:00100000:3.0:1789575588.337414:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676272768 00000100:00100000:3.0:1789575588.337485:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:3.0:1789575588.337497:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676272768:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575588.337535:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.337563:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238390e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b6d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337647:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337904:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337920:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337941:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337949:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.337956:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338182:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338210:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338218:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575588.338272:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789575588.338277:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575588.338302:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338318:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338328:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338336:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338344:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338352:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575588.338357:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338850:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338868:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575588.338871:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575588.338889:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338896:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383915 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338913:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338919:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338926:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338931:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575588.338935:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338941:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338950:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575588.338952:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575588.338956:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.338962:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a2238391c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.339010:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a2238390e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.339052:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 55 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.339061:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575588.339064:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575588.339067:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031600, rc 0) 00000100:00100000:3.0:1789575588.339168:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10558:x1876505676272768:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1672us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.339179:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:2.0:1789575588.343925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.344083:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273024 00000100:00100000:3.0:1789575588.344097:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273024 00000100:00100000:3.0:1789575588.344182:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:3.0:1789575588.344197:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10558:x1876505676273024:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575588.344230:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.344260:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238392a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b74 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345094:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345116:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345126:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345134:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345204:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345222:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 56 pid: 5864 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.345239:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699361920:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575588.345468:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.345478:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.345487:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699362048:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575588.345513:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575588.348703:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699361920:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575588.350434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.350564:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273152 00000100:00100000:1.0:1789575588.350578:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273152 00010000:00010000:1.0:1789575588.350642:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 57 pid: 5864 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575588.350706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:1.0:1789575588.350718:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+57:2355:x1876505676273152:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575588.350740:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575588.350748:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 57 pid: 5864 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.350763:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 57 pid: 5864 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.350908:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b6d expref: 57 pid: 5864 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.350929:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575588.350935:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.350945:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.350972:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575588.351054:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+56:2355:x1876505676273152:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 337us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575588.351062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789575588.354671:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699362048:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575588.354716:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.357257:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.357743:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273280 00000100:00100000:0.0:1789575588.357763:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273280 00010000:00010000:0.0:1789575588.357839:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.357895:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789575588.357907:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+56:2357:x1876505676273280:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575588.357927:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575588.357936:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.357952:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.357980:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a223838f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b5f expref: 56 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.358000:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575588.358007:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.358053:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.358063:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.358111:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575588.358197:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+55:2357:x1876505676273280:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 291us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575588.358205:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00010000:00010000:2.0:1789575588.358679:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.358689:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575588.358728:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789575588.358956:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238392a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.358978:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.358987:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575588.358990:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789575588.358993:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:2.0:1789575588.359054:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10558:x1876505676273024:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 14861us (15145us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789575588.359064:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:2.0:1789575588.367607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.367829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273536 00000100:00100000:1.0:1789575588.367851:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273536 00000100:00100000:1.0:1789575588.367972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789575588.367988:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10558:x1876505676273536:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:1.0:1789575588.368016:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575588.368068:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b4a expref: 55 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.368103:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575588.368113:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575588.368223:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676273536:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 239us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575588.368232:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789575588.372317:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.372677:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273664 00000100:00100000:3.0:1789575588.372694:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273664 00000100:00100000:3.0:1789575588.372794:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789575588.372808:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676273664:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:3.0:1789575588.372993:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.373017:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.373055:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575588.373338:0:9231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789575588.373521:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676273664:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 716us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.373531:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:2.0:1789575588.377181:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.377966:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273792 00000100:00100000:3.0:1789575588.377982:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273792 00000100:00100000:3.0:1789575588.378189:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:3.0:1789575588.378203:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+54:10558:x1876505676273792:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575588.378235:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.378266:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b7b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378346:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378358:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 55 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378476:0:5864:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378495:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 55 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378511:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575588.378606:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575588.378612:0:5864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 55 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.378621:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030a00, rc 0) 00000100:00100000:3.0:1789575588.378931:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10558:x1876505676273792:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 730us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.378940:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00000040:00080000:3.0:1789575588.649123:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575588.649137:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575588.649187:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789575588.649194:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575588.649358:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699362176:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575588.650442:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658780 going to sleep for 11 seconds 00000100:00100000:2.0:1789575588.658255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.659066:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bcd90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699362176:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789575588.664982:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676273920 00000100:00100000:0.0:1789575588.665004:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676273920 00000100:00100000:0.0:1789575588.665196:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:0.0:1789575588.665209:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10560:x1876505676273920:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789575588.665266:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789575588.665448:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10560:x1876505676273920:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 241us (7206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575588.665457:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:2.0:1789575588.671134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.674170:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676274048 00000100:00100000:3.0:1789575588.674192:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676274048 00000100:00100000:3.0:1789575588.674307:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:3.0:1789575588.674320:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10560:x1876505676274048:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789575588.674442:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.674466:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.674481:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681830:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681864:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681881:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681923:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681955:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.681963:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575588.682027:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789575588.682034:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575588.682065:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682079:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682087:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682095:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682102:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575588.682107:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682117:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682142:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575588.682146:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575588.682152:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682171:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a2238394d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682194:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682201:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682207:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682212:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575588.682216:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682224:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682232:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e9683773a00) 00010000:00010000:2.0:1789575588.682234:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575588.682237:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682243:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383954 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682259:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682265:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682278:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682283:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575588.682285:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682292:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682300:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575588.682303:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575588.682306:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.682311:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238395b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.682472:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10560:x1876505676274048:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 8144us (11341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.682486:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:1.0:1789575588.698217:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.698349:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676274304 00000100:00100000:3.0:1789575588.698408:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676274304 00000100:00100000:3.0:1789575588.698471:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789575588.698483:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+55:10560:x1876505676274304:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575588.698504:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.698525:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383962 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b82 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.698642:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.698661:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.698674:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575588.698688:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789575588.699172:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699191:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699201:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699207:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575588.699241:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699252:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699272:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575588.699276:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789575588.699282:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699290:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699366:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383962 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b82 expref: 57 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699441:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575588.699444:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575588.699451:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a22383962 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b82 expref: 57 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.699469:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680031600, rc 0) 00000100:00100000:2.0:1789575588.699569:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676274304:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1086us (1362us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789575588.699581:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789575588.714659:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.714778:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676274432 00000100:00100000:2.0:1789575588.714788:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676274432 00000100:00100000:2.0:1789575588.714852:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789575588.714861:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676274432:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789575588.714905:0:7184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789575588.715182:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676274432:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 320us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.715476:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:0.0:1789575588.727440:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.727868:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676274688 00000100:00100000:2.0:1789575588.727882:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676274688 00000100:00100000:2.0:1789575588.728070:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:2.0:1789575588.728084:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676274688:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575588.728111:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575588.728115:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789575588.728151:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b66 expref: 56 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.728178:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:2.0:1789575588.728184:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575588.728253:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383977 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b89 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789575588.728921:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789575588.730051:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238397e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.730069:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.730082:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238397e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.730162:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383977 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b89 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.730182:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238397e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b89 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.730918:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:2.0:1789575588.730983:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575588.730988:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9800, rc 0) 00000100:00100000:2.0:1789575588.731091:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+57:10560:x1876505676274688:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 3008us (3717us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789575588.731100:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789575588.741417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.741571:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676274944 00000100:00100000:3.0:1789575588.741585:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676274944 00000100:00100000:3.0:1789575588.741652:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:3.0:1789575588.741662:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+57:10560:x1876505676274944:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789575588.741728:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575588.741760:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238397e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b89 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741793:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9683773a00) 00010000:00010000:3.0:1789575588.741823:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575588.741859:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741873:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741884:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741900:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741907:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.741913:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742120:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742139:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742147:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742154:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575588.742160:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742170:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742187:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575588.742326:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575588.742331:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742337:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680031600/0xc45cc82a2238398c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742348:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742355:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742360:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742366:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575588.742414:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742422:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742431:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf91943c7 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575588.742434:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575588.742437:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.742443:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a22383993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf91943c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575588.742666:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676274944:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1002us (1256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575588.742674:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:3.0:1789575588.759107:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.760598:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676275072 00000100:00100000:0.0:1789575588.760619:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676275072 00000100:00100000:0.0:1789575588.760725:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:0.0:1789575588.760739:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+56:10560:x1876505676275072:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575588.760767:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575588.760802:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238399a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b90 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.760876:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.760893:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.760908:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.761032:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a2238399a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.761069:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.761080:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:0.0:1789575588.761084:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789575588.761089:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077e00, rc 0) 00000100:00100000:0.0:1789575588.761172:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+57:10560:x1876505676275072:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 436us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575588.761180:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:0.0:1789575588.766352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.770009:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676275328 00000100:00100000:2.0:1789575588.770031:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676275328 00000100:00100000:2.0:1789575588.770137:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:2.0:1789575588.770151:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+57:10560:x1876505676275328:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575588.770271:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.770296:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.770312:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575588.770686:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789575588.770696:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400857324737ns, next at 401857322175ns, rc = 0 00000004:00010000:2.0:1789575588.770821:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080d985a1 reply state 00000000638fb476 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.770833:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575588.771223:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+59:10560:x1876505676275328:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1072us (4886us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789575588.771233:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00010000:00010000:3.0:1789575588.777911:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.777937:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.777947:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.777954:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575588.777961:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.777971:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.777998:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:3.0:1789575588.778002:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789575588.778009:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.778016:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223839a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.780432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.780763:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676275456 00000100:00100000:3.0:1789575588.780776:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676275456 00000100:00100000:3.0:1789575588.780875:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:3.0:1789575588.780888:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+58:10560:x1876505676275456:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575588.780924:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575588.780953:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b97 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.781054:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 59 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.781074:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 59 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.781099:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:3.0:1789575588.781102:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575588.781107:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9680030800, rc 0) 00000100:00100000:3.0:1789575588.781614:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+59:10560:x1876505676275456:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 726us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.781622:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:1.0:1789575588.797905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.798018:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676275584 00000100:00100000:2.0:1789575588.798032:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676275584 00000100:00100000:2.0:1789575588.798133:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789575588.798145:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676275584:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789575588.798729:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676275584:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 501us (756us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789575588.798741:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00080000:0.0:1789575588.798950:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575588.805510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.805627:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676275840 00000100:00100000:3.0:1789575588.805642:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676275840 00000100:00100000:3.0:1789575588.805724:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789575588.805737:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+59:10560:x1876505676275840:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789575588.806675:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+60:10560:x1876505676275840:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 935us (1175us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789575588.806686:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:1.0:1789575588.820363:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.821611:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276096 00000100:00100000:2.0:1789575588.821633:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276096 00000100:00100000:2.0:1789575588.821739:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:2.0:1789575588.821753:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:10560:x1876505676276096:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789575588.822089:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:10560:x1876505676276096:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 337us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.822098:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:1.0:1789575588.825972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.826234:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276224 00000100:00100000:2.0:1789575588.826248:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276224 00000100:00100000:2.0:1789575588.826325:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:2.0:1789575588.826337:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+60:10560:x1876505676276224:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575588.826430:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575588.826460:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223839b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5b9e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826553:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826571:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826587:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575588.826636:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575588.826660:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826692:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223839b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b9e expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826710:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b9e expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.826719:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575588.826723:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789575588.826727:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9000, rc 0) 00000100:00100000:2.0:1789575588.826798:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+61:10560:x1876505676276224:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 463us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.826806:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:3.0:1789575588.838549:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.839507:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276352 00000100:00100000:1.0:1789575588.839523:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276352 00000100:00100000:1.0:1789575588.839610:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:1.0:1789575588.839635:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676276352:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789575588.839661:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575588.839690:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ba5 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789575588.839729:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaac1a4, blocks: 0x1 00010000:00010000:1.0:1789575588.839755:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1789575588.839760:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575588.839772:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.840023:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.840054:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0600, rc 0) 00000100:00100000:1.0:1789575588.840155:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2356:x1876505676276352:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 522us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575588.840164:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00010000:00010000:1.0:1789575588.842313:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575588.851300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575588.851895:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276608 00000100:00100000:3.0:1789575588.851912:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276608 00000100:00100000:3.0:1789575588.852067:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:3.0:1789575588.852082:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+61:10560:x1876505676276608:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789575588.852277:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+61:10560:x1876505676276608:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 199us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575588.852285:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:0.0:1789575588.860183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.860338:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276736 00000100:00100000:2.0:1789575588.860352:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276736 00000100:00100000:2.0:1789575588.860615:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:2.0:1789575588.860627:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:10560:x1876505676276736:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575588.860854:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575588.860959:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bac expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.861033:0:9232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.861055:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575588.861060:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575588.861066:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 9 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.861111:0:9232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.861129:0:9232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.861146:0:9232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699362304:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575588.861273:0:9232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789575588.865067:0:9232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699362304:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575588.865121:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 9 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.865147:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:2.0:1789575588.865233:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:10560:x1876505676276736:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4607us (5064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.865244:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:1.0:1789575588.868459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.868697:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276864 00000100:00100000:0.0:1789575588.868711:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276864 00010000:00010000:0.0:1789575588.868766:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.868822:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:0.0:1789575588.868834:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2358:x1876505676276864:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575588.868854:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575588.868904:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.868920:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.868948:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a223839c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ba5 expref: 9 pid: 6709 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.868972:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575588.868976:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575588.868985:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.868996:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575588.869059:0:8471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575588.869078:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8471:1876505699362432:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789575588.869198:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575588.879668:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9687eaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8471:1876505699362432:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789575588.879709:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575588.879789:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676276864:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 10956us (11344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575588.879803:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:3.0:1789575588.880884:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575588.881082:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676276992 00000100:00100000:0.0:1789575588.881095:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676276992 00002000:00100000:0.0:1789575588.881162:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e96bbd04700 x1876505676276992/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:609/0 lens 504/0 e 0 to 0 dl 1789575599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789575588.881199:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbd04700 with x1876505676276992 ext(0->12) 00002000:00010000:0.0:1789575588.881206:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bbd04700 00000100:00100000:0.0:1789575588.881241:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789575588.881252:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676276992:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789575588.882313:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676276992:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 1053us (1427us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789575588.882327:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00002000:00100000:0.0:1789575588.882337:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e96bbd04700 x1876505676276992/t4294967309(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:609/0 lens 504/448 e 0 to 0 dl 1789575599 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789575588.882347:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbd04700 with x1876505676276992 ext(0->12) 00002000:00010000:0.0:1789575588.882353:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bbd04700 00000100:00100000:1.0:1789575588.892592:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575588.892880:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676277120 00000100:00100000:2.0:1789575588.892894:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676277120 00000100:00100000:2.0:1789575588.892975:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:2.0:1789575588.892987:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+61:10560:x1876505676277120:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789575588.983736:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:0.0:1789575588.983769:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789575588.983864:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9690c77e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789575588.983871:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96829f3000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9690c77c00 00000020:00080000:0.0:1789575588.983876:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96829f3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bbd68000 00000001:00080000:0.0:1789575588.983899:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1789575588.983903:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1789575588.983940:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1789575588.983968:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9699eebe40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789575588.983971:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bbda3900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9690b95780 00000020:00080000:0.0:1789575588.983974:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bbda3400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bcdc7000 00000004:00080000:0.0:1789575588.983995:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789575588.984048:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789575588.984327:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789575588.985022:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699362560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789575588.985127:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575588.985706:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699362560 00000100:00100000:3.0:1789575588.985718:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699362560 00000100:00100000:3.0:1789575588.985808:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789575588.985819:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699362560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789575588.985858:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789575588.985906:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaac1a3, atime: 0x6aaac1a3, ctime: 0x6aaac1a3, blocks: 0xb 00010000:00010000:3.0:1789575588.985916:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.985938:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1789575588.985943:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575588.985952:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.985974:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.985985:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.986014:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.986046:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789575588.987054:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699362560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1219us (1910us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789575588.987066:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789575588.987102:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575588.987110:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.987120:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575588.987125:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.987137:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.987159:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.987167:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043ffcd4c/0xc45cc82a223839d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575588.987191:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575588.987201:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575588.987203:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575588.987405:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575588.987689:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789575588.987706:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1789575588.987733:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bc946d80, transno 4294967301 00000100:00100000:2.0:1789575588.987753:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e96bb5b7800 x1876505699361664/t4294967303(4294967303) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1789575603 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789575588.987768:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bbd07800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789575588.987775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699362560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789575588.989181:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575588.989203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699362688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789575588.989288:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575588.989536:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699362688 00000100:00100000:2.0:1789575588.989547:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699362688 00000100:00100000:2.0:1789575588.989607:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789575588.989618:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699362688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789575588.989653:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1789575588.989687:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.989715:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 9 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.989725:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789575588.989730:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575588.989737:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.989772:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 9 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.989789:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 9 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.989827:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1876505699362944:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575588.989904:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575588.990191:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575588.990217:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699362816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789575588.990257:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575588.990875:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699362816 00000100:00100000:0.0:1789575588.990884:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699362816 00000100:00100000:0.0:1789575588.990940:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789575588.990950:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699362816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789575588.991178:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789575588.991182:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789575589 00002000:00010000:0.0:1789575588.991184:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789575588.991186:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789575588 -> 1789575589 00002000:00010000:0.0:1789575588.991188:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789575588.991257:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876505699362816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (998us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789575588.991265:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1789575588.991317:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bc39b100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789575588.991324:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699362816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789575588.991929:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10560:x1876505676277120:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 98940us (99348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575588.991941:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:0.0:1789575588.995464:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575588.997822:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676277248 00000100:00100000:1.0:1789575588.997872:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676277248 00010000:00010000:1.0:1789575588.997946:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 10 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575588.998001:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:1.0:1789575588.998014:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676277248:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575588.998049:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575588.998059:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 10 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.998086:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 10 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.998124:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575588.998129:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575588.998137:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.998149:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575588.998185:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575588.998263:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676277248:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 251us (2815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575588.998271:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00010000:00010000:2.0:1789575588.998831:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22383794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b0b expref: 9 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575588.998849:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc404700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1876505699362944:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575588.998877:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.998888:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.998896:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.998909:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.998918:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575588.998935:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789575588.999985:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575588.999997:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.000021:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575589.000027:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.000048:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.000072:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.000080:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a223839d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.000103:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575589.000105:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575589.000107:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575589.000944:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699362688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11319us (11647us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789575589.000969:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1789575589.001363:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bc398e00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789575589.001408:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699362688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789575589.008936:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.017581:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676277376 00000100:00100000:2.0:1789575589.017605:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676277376 00000100:00100000:2.0:1789575589.017708:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789575589.017721:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676277376:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789575589.101814:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789575589.101838:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789575589.101923:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1789575589.102215:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676277376:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 84487us (93285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575589.102230:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:1.0:1789575589.105879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.105997:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676277632 00000100:00100000:2.0:1789575589.106010:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676277632 00000100:00100000:2.0:1789575589.106107:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:2.0:1789575589.106119:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10560:x1876505676277632:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575589.106190:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575589.106229:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223839bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b9e expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.106252:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575589.106259:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575589.106312:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.106328:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.106340:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575589.107262:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e5955fd reply state 00000000bdb88271 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.107301:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575589.107777:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+16:10560:x1876505676277632:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1653us (1907us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789575589.107788:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00010000:00010000:1.0:1789575589.118226:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118255:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118264:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118293:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575589.118301:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118311:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118335:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:1.0:1789575589.118339:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575589.118344:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.118351:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a223839e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.122273:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.122426:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676277760 00000100:00100000:2.0:1789575589.122439:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676277760 00000100:00100000:2.0:1789575589.122522:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:2.0:1789575589.122534:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2355:x1876505676277760:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789575589.122859:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789575589.122863:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789575589 -> 1789575588 00002000:00010000:2.0:1789575589.122866:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789575587 00002000:00010000:2.0:1789575589.122868:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789575589 -> 1789575588 00002000:00010000:2.0:1789575589.122871:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789575589.122944:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676277760:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 411us (688us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789575589.122952:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:2.0:1789575589.131885:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575589.133846:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278016 00000100:00100000:3.0:1789575589.133869:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278016 00000100:00100000:3.0:1789575589.133969:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:3.0:1789575589.133982:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+15:10560:x1876505676278016:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789575589.134084:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.134106:0:9231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.134117:0:9231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.134164:0:9231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.134180:0:9231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 15 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575589.134198:0:9231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699363072:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575589.134345:0:9231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575589.138831:0:9231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699363072:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575589.138895:0:9231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.139028:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575589.139103:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278144 00000100:00100000:3.0:1789575589.139113:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278144 00010000:00010000:3.0:1789575589.139211:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 16 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575589.139267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:3.0:1789575589.139277:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+16:2358:x1876505676278144:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575589.139296:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575589.139304:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 16 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139317:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 16 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a223839a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b90 expref: 16 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139362:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:3.0:1789575589.139417:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139430:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139440:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.139480:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575589.139544:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+15:2358:x1876505676278144:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 268us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575589.139552:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00010000:00010000:2.0:1789575589.139694:0:9231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139704:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139741:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139748:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139765:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139772:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575589.139777:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139788:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139798:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575589.139801:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789575589.139805:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.139812:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a223839e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.139911:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10560:x1876505676278016:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 5932us (8041us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789575589.139921:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:1.0:1789575589.152551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575589.153557:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278272 00000100:00100000:3.0:1789575589.153576:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278272 00000100:00100000:3.0:1789575589.153667:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789575589.153680:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676278272:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789575589.153748:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.153774:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.153784:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789575589.153790:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575589.153795:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.153844:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.153861:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 7 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575589.153880:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699363200:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575589.154016:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575589.158123:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699363200:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575589.158167:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.159707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.160436:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278400 00000100:00100000:2.0:1789575589.160455:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278400 00010000:00010000:2.0:1789575589.160527:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.160581:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789575589.160594:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676278400:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575589.160633:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575589.160664:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.160681:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.160708:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c5eb33/0xc45cc82a223839cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bac expref: 8 pid: 9232 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.160733:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575589.160738:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575589.160746:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.160758:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.160792:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575589.160883:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676278400:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 291us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575589.160892:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00010000:00010000:3.0:1789575589.161401:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161415:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161448:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161458:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161466:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161474:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575589.161479:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161488:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161528:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.161537:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876b112f/0xc45cc82a223839ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575589.161605:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676278272:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 7928us (9070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575589.161613:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789575589.176782:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575589.176948:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278656 00000100:00100000:1.0:1789575589.176961:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278656 00000100:00100000:1.0:1789575589.177046:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:1.0:1789575589.177058:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10560:x1876505676278656:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789575589.177167:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177189:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177233:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177701:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177715:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 15 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177725:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177768:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 15 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.177786:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 15 pid: 9231 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.177803:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc947800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699363328:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575589.178647:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789575589.187549:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.188158:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278784 00000100:00100000:2.0:1789575589.188173:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278784 00010000:00010000:2.0:1789575589.188226:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 16 pid: 9231 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.188295:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:2.0:1789575589.188306:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+16:2357:x1876505676278784:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575589.188328:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575589.188337:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 16 pid: 9231 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.188362:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 16 pid: 9231 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.188427:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575589.188434:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.188446:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.188455:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.188482:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575589.188564:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+16:2357:x1876505676278784:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 260us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575589.188572:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00010000:00010000:1.0:1789575589.189867:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030800/0xc45cc82a223839af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b97 expref: 15 pid: 9231 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.189897:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc947800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699363328:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575589.189930:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.189941:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.189969:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575589.190284:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789575589.190979:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789575589.191058:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789575589.191198:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc947800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699363456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789575589.191290:0:7184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575589.191342:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968133ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789575589.191901:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699363456 00000100:00100000:2.0:1789575589.191913:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699363456 00000100:00100000:2.0:1789575589.192000:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575589.192013:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699363456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789575589.192171:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699363456:12345-0@lo:1000:mdt00_003.0 Request processed in 160us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575589.192179:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789575589.192296:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575589.192720:0:7184:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789575589.192730:0:7184:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bc39b100, transno 4294967310 00000004:00080000:1.0:1789575589.192746:0:7184:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bc398e00, transno 4294967311 00000100:00100000:1.0:1789575589.192756:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc947800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699363456:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789575589.196438:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789575589.196582:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699363584:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789575589.196677:0:7184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575589.196731:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789575589.200591:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699363584 00000100:00100000:2.0:1789575589.200617:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699363584 00000100:00100000:2.0:1789575589.200723:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575589.200736:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699363584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789575589.201201:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7184:x1876505699363584:12345-0@lo:1000:mdt00_003.0 Request processed in 465us (4521us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789575589.201209:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789575589.202761:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699363584:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789575589.202834:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202848:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202857:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202864:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575589.202897:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202907:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202928:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:1.0:1789575589.202931:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575589.202938:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202945:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a223839fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202988:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.202995:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203000:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203006:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680030e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575589.203009:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203015:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203023:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575589.203025:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575589.203050:0:7184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203064:0:7184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203075:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.203130:0:7184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.203148:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699363712:192.168.202.32@tcp:105: 00000100:00100000:1.0:1789575589.203275:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969011e000 going to sleep for 11 seconds 00000100:00100000:0.0:1789575589.211591:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575589.211904:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3db800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699363712:192.168.202.32@tcp:105: 00010000:00010000:1.0:1789575589.211942:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.211954:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030e00/0xc45cc82a2238393f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.211996:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212014:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212028:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212082:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212089:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212097:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212103:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575589.212108:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212115:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212130:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575589.212133:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575589.212138:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212144:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383a03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212155:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212161:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212167:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212180:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575589.212184:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212190:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212201:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575589.212204:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789575589.212207:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.212214:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a223839f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575589.212714:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10560:x1876505676278656:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 35655us (35944us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789575589.212727:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 127 00000020:00080000:1.0:1789575589.212736:0:7184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789575589.213234:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575589.213240:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575589.213758:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789575589.213768:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575589.223211:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676278912 00000100:00100000:3.0:1789575589.223236:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676278912 00000100:00100000:3.0:1789575589.223693:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:3.0:1789575589.223707:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10558:x1876505676278912:12345-192.168.202.32@tcp:49:lfs.0 00000100:00100000:3.0:1789575589.223984:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10558:x1876505676278912:12345-192.168.202.32@tcp:49:lfs.0 Request processed in 280us (12408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575589.223993:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789575589.227785:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575589.227852:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575589.227945:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676279168 00000100:00100000:1.0:1789575589.227959:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676279168 00000100:00100000:1.0:1789575589.228046:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:1.0:1789575589.228061:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:10560:x1876505676279168:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789575589.229199:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789575589.229327:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789575589.229423:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.229445:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.229469:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.229480:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.229486:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.229492:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.232728:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789575589.232919:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+20:10560:x1876505676279168:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 4852us (5146us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789575589.232932:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000020:00080000:1.0:1789575589.232939:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575589.233014:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575589.233023:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.233047:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575589.233052:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.233064:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.233084:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e96831e1b00) 00010000:00010000:1.0:1789575589.233088:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789575589.233117:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.233123:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383a0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575589.233146:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575589.233148:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575589.233149:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575589.233966:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676279424 00000100:00100000:2.0:1789575589.233983:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676279424 00000100:00100000:2.0:1789575589.234054:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:2.0:1789575589.234067:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+20:10558:x1876505676279424:12345-192.168.202.32@tcp:58:lfs.0 00000040:00080000:2.0:1789575589.234459:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789575589.234564:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+20:10558:x1876505676279424:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 499us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575589.234573:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:0.0:1789575589.289098:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.289221:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676279552 00000100:00100000:2.0:1789575589.289236:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676279552 00000100:00100000:2.0:1789575589.289314:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:2.0:1789575589.289327:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+20:10562:x1876505676279552:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575589.289436:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575589.289465:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bb3 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289762:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289782:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289796:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289814:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289821:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.289827:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.290152:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.290165:0:9231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.290176:0:9231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.290221:0:9231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.290247:0:9231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 21 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.290265:0:9231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699363840:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575589.290737:0:9231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bcc9fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575589.308317:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575589.308674:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676279808 00000100:00100000:0.0:1789575589.308687:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676279808 00000100:00100000:0.0:1789575589.308763:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:0.0:1789575589.308775:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+22:5598:x1876505676279808:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789575589.309180:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:5598:x1876505676279808:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 405us (878us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789575589.309189:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789575589.309433:0:9231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699363840:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575589.309463:0:9231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575589.317728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575589.317847:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676279936 00000100:00100000:2.0:1789575589.317861:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676279936 00010000:00010000:2.0:1789575589.317917:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 23 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575589.317970:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:2.0:1789575589.317982:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+23:2357:x1876505676279936:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575589.318002:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575589.318009:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 23 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318023:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 23 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318060:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b74 expref: 23 pid: 5862 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575589.318107:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318118:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318126:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575589.318167:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575589.318290:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+22:2357:x1876505676279936:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 310us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575589.318298:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00010000:00010000:3.0:1789575589.318528:0:9231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318537:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575589.318599:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789575589.318605:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575589.318629:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318660:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318672:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318679:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318686:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318693:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575589.318698:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318706:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318717:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:3.0:1789575589.318720:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575589.318724:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318730:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318742:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318747:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318761:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318767:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575589.318770:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318776:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318785:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9683773200) 00010000:00010000:3.0:1789575589.318788:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575589.318791:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318796:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318840:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bb3 expref: 22 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318856:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bb3 expref: 21 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575589.318865:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575589.318867:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575589.318869:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9800, rc 0) 00000100:00100000:3.0:1789575589.318906:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10562:x1876505676279552:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 29583us (29826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575589.318924:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00010000:00010000:2.0:1789575589.864918:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789575590.253160:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575590.253179:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575590.253232:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789575590.253240:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575590.254677:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699363968:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575590.255715:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789575590.264555:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575590.264721:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676280064 00000100:00100000:2.0:1789575590.264741:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676280064 00000100:00100000:2.0:1789575590.264856:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:2.0:1789575590.264868:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+22:10573:x1876505676280064:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789575590.264921:0:7184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789575590.265092:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+22:10573:x1876505676280064:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 225us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575590.265101:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00080000:0.0:1789575590.265403:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575590.265564:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699363968:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575590.269621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575590.269686:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676280320 00000100:00100000:3.0:1789575590.269700:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676280320 00000100:00100000:3.0:1789575590.269789:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:3.0:1789575590.269805:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+21:10573:x1876505676280320:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575590.269837:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575590.269868:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bba expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.270010:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.270052:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.270072:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575590.270089:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789575590.270820:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bba expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.270847:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bba expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.270856:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575590.270860:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575590.270864:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0200, rc 0) 00000100:00100000:3.0:1789575590.270958:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+23:10573:x1876505676280320:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1157us (1356us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789575590.270968:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:3.0:1789575590.294174:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575590.294234:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575590.294278:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676280704 00000100:00100000:3.0:1789575590.294290:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676280704 00000100:00100000:3.0:1789575590.294395:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575590.294408:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+23:2357:x1876505676280704:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575590.294428:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575590.294461:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bba expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575590.294485:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:3.0:1789575590.294492:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575590.294562:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+22:2357:x1876505676280704:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 157us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575590.294571:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:1.0:1789575590.294903:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676280576 00000100:00100000:1.0:1789575590.294909:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676280576 00000100:00100000:1.0:1789575590.294955:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:1.0:1789575590.294964:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+22:10573:x1876505676280576:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789575590.295078:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295101:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295115:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295429:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295440:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295449:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295455:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575590.295473:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295482:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295493:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:1.0:1789575590.295496:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789575590.295501:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575590.295508:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383a42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575590.295680:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+23:10573:x1876505676280576:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 716us (1521us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789575590.295690:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 132 00000040:00080000:3.0:1789575590.296418:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575590.296465:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575590.296974:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789575590.296986:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575590.309904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575590.309954:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676280960 00000100:00100000:3.0:1789575590.309968:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676280960 00000100:00100000:3.0:1789575590.310049:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789575590.310062:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:10573:x1876505676280960:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789575590.310413:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+24:10573:x1876505676280960:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 353us (524us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789575590.310422:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000040:00080000:2.0:1789575590.447289:0:12084:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575590.447302:0:12084:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575590.447716:0:12084:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789575590.447724:0:12084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789575590.560063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575590.560724:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281216 00000100:00100000:2.0:1789575590.560745:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281216 00000100:00100000:2.0:1789575590.560859:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:2.0:1789575590.560875:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+24:10587:x1876505676281216:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575590.560922:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575590.560962:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bc1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575590.561171:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575590.561196:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575590.561215:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575590.561230:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789575590.561513:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc1 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575590.561538:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc1 expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575590.561549:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:2.0:1789575590.561553:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789575590.561559:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8a00, rc 0) 00000100:00100000:2.0:1789575590.561674:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10587:x1876505676281216:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 802us (1634us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789575590.561715:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:3.0:1789575590.568281:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575590.568458:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281344 00000100:00100000:0.0:1789575590.568472:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281344 00000100:00100000:0.0:1789575590.568549:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:0.0:1789575590.568563:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10587:x1876505676281344:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789575590.568668:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568699:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568715:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568751:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568948:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568955:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568963:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575590.568968:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568976:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.568991:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575590.568994:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575590.569000:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.569005:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076a00/0xc45cc82a22383a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575590.569194:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:10587:x1876505676281344:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 632us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575590.569203:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:3.0:1789575590.665908:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575590.667308:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281472 00000100:00100000:0.0:1789575590.667331:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281472 00000100:00100000:0.0:1789575590.667463:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:0.0:1789575590.667476:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676281472:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:0.0:1789575590.667502:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575590.667551:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a22383a65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bc8 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789575590.667592:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaac1a4, atime: 0x6aaac1a3, ctime: 0x6aaac1a4, blocks: 0xb 00010000:00010000:0.0:1789575590.667625:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1789575590.667629:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575590.667639:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a22383a65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc8 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.667659:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a22383a65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc8 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575590.667678:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076a00, rc 0) 00000100:00100000:0.0:1789575590.668096:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676281472:12345-192.168.202.32@tcp:101:cat.0 Request processed in 619us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575590.668105:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00080000:3.0:1789575590.670166:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575590.675265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575590.675399:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281600 00000100:00100000:1.0:1789575590.675415:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281600 00002000:00100000:1.0:1789575590.675482:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e96bc405180 x1876505676281600/t0(0) o3->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:611/0 lens 488/0 e 0 to 0 dl 1789575601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575590.675496:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc405180 with x1876505676281600 ext(0->4095) 00002000:00010000:1.0:1789575590.675503:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc405180 00000100:00100000:1.0:1789575590.675535:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789575590.675546:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676281600:12345-192.168.202.32@tcp:3:cat.0 00000100:00100000:1.0:1789575590.675988:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676281600:12345-192.168.202.32@tcp:3:cat.0 Request processed in 441us (741us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789575590.676015:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00002000:00100000:1.0:1789575590.676035:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e96bc405180 x1876505676281600/t0(0) o3->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:611/0 lens 488/4536 e 0 to 0 dl 1789575601 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789575590.676044:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bc405180 with x1876505676281600 ext(0->4095) 00002000:00010000:1.0:1789575590.676048:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bc405180 00010000:00010000:1.0:1789575590.889366:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575591.057861:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575591.057918:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575591.057958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575591.058149:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281856 00000100:00100000:2.0:1789575591.058164:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281856 00000100:00100000:2.0:1789575591.058266:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:2.0:1789575591.058279:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676281856:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575591.058433:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676281856:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 157us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575591.058442:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:1.0:1789575591.059132:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281728 00000100:00100000:1.0:1789575591.059144:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281728 00000100:00100000:1.0:1789575591.059208:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00100000:1.0:1789575591.059217:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676281728:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575591.059273:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676281728:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 58us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575591.059282:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00080000:0.0:1789575591.059530:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575591.060212:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676281984 00000100:00100000:3.0:1789575591.060222:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676281984 00000100:00100000:3.0:1789575591.060454:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:3.0:1789575591.060465:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676281984:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575591.060539:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676281984:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 78us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575591.060546:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00080000:0.0:1789575591.061749:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575591.337145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575591.337178:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575591.337298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575591.337544:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364096 00000100:00100000:1.0:1789575591.337556:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364096 00000100:00100000:1.0:1789575591.337644:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789575591.337655:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876505699364096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575591.337701:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575591.337760:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876505699364096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575591.337768:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789575591.337971:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575591.338033:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575591.914549:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575592.367533:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699364480:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.367646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575592.367727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575592.367754:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364608:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.367790:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575592.367844:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364480 00000100:00100000:1.0:1789575592.367856:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364480 00000100:00100000:1.0:1789575592.367938:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789575592.367950:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699364480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.368124:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699364352:0@lo:400:kworker.0 00000100:00100000:0.0:1789575592.368199:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699364224:0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.373555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575592.373667:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699364864:0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.373719:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575592.373941:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364352 00000100:00100000:3.0:1789575592.373952:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364352 00000100:00100000:0.0:1789575592.374171:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575592.374226:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699364736:0@lo:400:kworker.0 00000100:00100000:0.0:1789575592.374260:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575592.377250:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699364480:12345-0@lo:400:kworker.0 Request processed in 9286us (9587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575592.377270:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789575592.378570:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364224 00000100:00100000:0.0:1789575592.378613:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364224 00000100:00100000:0.0:1789575592.378684:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789575592.378695:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699364224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575592.378799:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699364224:12345-0@lo:400:kworker.0 Request processed in 106us (4628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575592.378806:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789575592.380281:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364736 00000100:00100000:3.0:1789575592.380308:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364736 00000100:00100000:3.0:1789575592.380535:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789575592.380547:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699364352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.380652:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699364352:12345-0@lo:400:kworker.0 Request processed in 108us (7113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575592.380660:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789575592.380680:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789575592.380686:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699364736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.380720:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699364736:12345-0@lo:400:kworker.0 Request processed in 34us (6460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575592.380726:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789575592.380758:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364608 00000100:00100000:3.0:1789575592.380763:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364608 00000100:00100000:3.0:1789575592.380796:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364864 00000100:00100000:3.0:1789575592.380800:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364864 00000100:00100000:3.0:1789575592.380826:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789575592.380834:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876505699364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.380872:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1876505699364608:12345-0@lo:400:kworker.0 Request processed in 39us (13080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575592.380879:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789575592.380891:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789575592.380897:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.380928:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699364864:12345-0@lo:400:kworker.0 Request processed in 31us (7209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575592.380956:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789575592.381465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699364352:0@lo:400:kworker.0 00000100:00100000:3.0:1789575592.381483:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699364864:0@lo:400:kworker.0 00000100:00080000:1.0:1789575592.383620:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575592.383641:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575592.383740:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364608:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.383760:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699364480:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.392562:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699364224:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.392597:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc3db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699364736:0@lo:400:kworker.0 00000100:00100000:1.0:1789575592.878192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575592.878274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575592.878678:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699364992 00000100:00100000:3.0:1789575592.878689:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699364992 00000100:00100000:3.0:1789575592.878748:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789575592.878769:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699364992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575592.878806:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575592.878855:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699364992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575592.878862:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789575592.879254:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc39b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699364992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575592.937177:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789575592.978141:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1789575592.978168:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:3.0:1789575593.384593:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575593.384602:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575593.384632:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789575593.384638:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789575593.960561:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789575593.994282:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:0.0:1789575593.994302:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789575593.994399:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1789575593.994415:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e968975e0c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789575593.994421:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e9687eb0900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e968a396240 00000020:00080000:0.0:1789575593.994425:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e9687eb0f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bbd41400 00000001:00080000:0.0:1789575593.994438:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789575593.994571:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789575593.994811:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789575594.455977:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789575594.456012:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789575594.987009:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575596.009201:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575596.172483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575596.172536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575596.172572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575596.172616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575596.172647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575596.172685:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282496 00000100:00100000:3.0:1789575596.172699:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282496 00000100:00100000:3.0:1789575596.172794:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282368 00000100:00100000:3.0:1789575596.172798:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282368 00000100:00100000:3.0:1789575596.172827:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:3.0:1789575596.172839:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676282496:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575596.172938:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676282496:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 102us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.172946:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:3.0:1789575596.172965:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:3.0:1789575596.172987:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676282368:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575596.173013:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676282368:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.173020:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:3.0:1789575596.173052:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282240 00000100:00100000:3.0:1789575596.173056:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282240 00000100:00100000:3.0:1789575596.173090:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282624 00000100:00100000:3.0:1789575596.173093:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282624 00000100:00100000:3.0:1789575596.173113:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:3.0:1789575596.173119:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2356:x1876505676282240:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575596.173150:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2356:x1876505676282240:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.173156:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:3.0:1789575596.173170:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:3.0:1789575596.173175:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676282624:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575596.173199:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676282624:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.173215:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00080000:3.0:1789575596.173234:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789575596.173241:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789575596.173243:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575596.173456:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282112 00000100:00100000:3.0:1789575596.173460:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282112 00000100:00100000:3.0:1789575596.173487:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 300 00000100:00100000:3.0:1789575596.173494:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676282112:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575596.173529:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676282112:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 35us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.173535:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 300 00000100:00100000:0.0:1789575596.461320:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699365120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575596.461576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575596.467269:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365120 00000100:00100000:3.0:1789575596.467293:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365120 00000100:00100000:3.0:1789575596.467464:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789575596.467477:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699365120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575596.467528:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575596.467651:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699365120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575596.467659:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789575596.468786:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789575596.468801:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789575596.468836:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bbd07800, transno 4294967304 00000100:00100000:0.0:1789575596.468877:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc398e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699365120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575596.470187:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575596.742019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575596.743211:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676282752 00000100:00100000:0.0:1789575596.743230:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676282752 00000100:00100000:0.0:1789575596.743325:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:0.0:1789575596.743338:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10248:x1876505676282752:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789575596.743554:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10248:x1876505676282752:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 218us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575596.743580:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:3.0:1789575596.762161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575596.762296:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283008 00000100:00100000:1.0:1789575596.762309:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283008 00000100:00100000:1.0:1789575596.762402:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:1.0:1789575596.762412:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+13:10248:x1876505676283008:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789575596.762790:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+14:10248:x1876505676283008:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 378us (642us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789575596.762816:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00010000:00010000:1.0:1789575597.032990:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575597.482287:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699365632:0@lo:400:kworker.0 00000100:00100000:0.0:1789575597.482418:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575597.482502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575597.482508:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc83bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699365504:0@lo:400:kworker.0 00000100:00100000:0.0:1789575597.482565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575597.483941:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc83b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699365248:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.484044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575597.484101:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699365760:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.484131:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575597.484167:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789575597.484174:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699365376:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.484202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575597.484229:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699365888:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.484255:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575597.484505:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365248 00000100:00100000:0.0:1789575597.484521:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365248 00000100:00100000:0.0:1789575597.484597:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789575597.484609:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699365248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575597.484687:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699365248:12345-0@lo:400:kworker.0 Request processed in 80us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575597.484695:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789575597.486000:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365504 00000100:00100000:0.0:1789575597.486016:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365504 00000100:00100000:0.0:1789575597.486086:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365760 00000100:00100000:0.0:1789575597.486089:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365760 00000100:00100000:0.0:1789575597.486111:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365376 00000100:00100000:0.0:1789575597.486113:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365376 00000100:00100000:0.0:1789575597.486133:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789575597.486143:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699365504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575597.486424:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365632 00000100:00100000:3.0:1789575597.486429:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365632 00000100:00100000:3.0:1789575597.486462:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699365888 00000100:00100000:3.0:1789575597.486464:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699365888 00000100:00100000:3.0:1789575597.486484:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789575597.486502:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699365632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575597.486570:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699365632:12345-0@lo:400:kworker.0 Request processed in 69us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575597.486577:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789575597.486593:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789575597.486599:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699365888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575597.486625:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699365888:12345-0@lo:400:kworker.0 Request processed in 27us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575597.486630:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789575597.486648:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789575597.486655:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699365760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575597.486686:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699365760:12345-0@lo:400:kworker.0 Request processed in 33us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575597.486692:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789575597.486720:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789575597.486727:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699365376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575597.487072:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699365504:12345-0@lo:400:kworker.0 Request processed in 930us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575597.487079:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789575597.487449:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699365376:12345-0@lo:400:kworker.0 Request processed in 720us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575597.487456:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789575597.488593:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc83bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699365504:0@lo:400:kworker.0 00000100:00100000:0.0:1789575597.488632:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699365632:0@lo:400:kworker.0 00000100:00080000:1.0:1789575597.489068:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575597.489079:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575597.489112:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699365376:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.489127:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789575597.489135:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1789575597.489163:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc83b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699365888:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.489176:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc83b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699365248:0@lo:400:kworker.0 00000100:00100000:1.0:1789575597.489190:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699365760:0@lo:400:kworker.0 00000100:00100000:3.0:1789575597.995922:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699366016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575597.996156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575597.996260:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366016 00000100:00100000:3.0:1789575597.996272:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366016 00000100:00100000:3.0:1789575597.997368:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789575597.997397:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699366016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575597.997471:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575597.997580:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699366016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575597.997588:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789575597.997715:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699366016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789575598.057284:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575599.091088:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789575599.170645:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789575599.170664:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789575599.170817:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789575599.170833:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1789575599.761026:0:12288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:19:57 (1789575597) 00010000:00010000:1.0:1789575600.112276:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575601.128885:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575601.303341:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.303457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.303501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.303532:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.303560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.303589:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283648 00000100:00100000:3.0:1789575601.303599:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283648 00000100:00100000:3.0:1789575601.303655:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283264 00000100:00100000:3.0:1789575601.303658:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283264 00000100:00100000:3.0:1789575601.303681:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:3.0:1789575601.303690:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676283648:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575601.303762:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676283648:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575601.303769:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:3.0:1789575601.303785:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:3.0:1789575601.303791:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2356:x1876505676283264:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575601.303832:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2356:x1876505676283264:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 41us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575601.303838:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:3.0:1789575601.304001:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283392 00000100:00100000:3.0:1789575601.304071:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283392 00000100:00100000:3.0:1789575601.304100:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283520 00000100:00100000:3.0:1789575601.304104:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283520 00000100:00100000:3.0:1789575601.304127:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:3.0:1789575601.304134:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676283392:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575601.304163:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676283392:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575601.304170:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:3.0:1789575601.304182:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:3.0:1789575601.304189:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676283520:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575601.304213:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676283520:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575601.304218:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00080000:1.0:1789575601.304609:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575601.304614:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789575601.304617:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575601.305138:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283136 00000100:00100000:0.0:1789575601.305145:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283136 00000100:00100000:0.0:1789575601.305231:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 302 00000100:00100000:0.0:1789575601.305249:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676283136:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575601.305302:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676283136:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 63us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575601.305309:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 302 00000100:00100000:3.0:1789575601.457449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575601.457700:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676283904 00000100:00100000:2.0:1789575601.457766:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676283904 00000100:00100000:2.0:1789575601.457946:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:2.0:1789575601.457957:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+13:11299:x1876505676283904:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575601.457983:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575601.458043:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383a6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bcf expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458153:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458172:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458188:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458204:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458212:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458219:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458537:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383a81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458547:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383a81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458554:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383a81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575601.458565:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789575601.458738:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458756:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458763:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458979:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575601.458984:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.458994:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459049:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9683773600) 00010000:00010000:2.0:1789575601.459053:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575601.459059:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459064:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383a73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459077:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459083:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459089:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459094:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575601.459104:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459110:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459117:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e9683773d00) 00010000:00010000:2.0:1789575601.459120:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575601.459123:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.459129:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383a7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.460457:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383a6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bcf expref: 16 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.460486:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383a81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bcf expref: 15 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575601.460495:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575601.460497:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575601.460500:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575601.460592:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+15:11299:x1876505676283904:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 2634us (3151us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789575601.460602:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:3.0:1789575601.470909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575601.471001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575601.471124:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284032 00000100:00100000:1.0:1789575601.471168:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284032 00000100:00100000:1.0:1789575601.471271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789575601.471284:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:2356:x1876505676284032:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575601.471303:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575601.471347:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383a81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bcf expref: 15 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575601.471427:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:1.0:1789575601.471435:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575601.471533:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+14:2356:x1876505676284032:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 251us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575601.471540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789575601.473108:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284160 00000100:00100000:0.0:1789575601.473120:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284160 00000100:00100000:0.0:1789575601.473173:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:0.0:1789575601.473183:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11299:x1876505676284160:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789575601.473278:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11299:x1876505676284160:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 96us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575601.473285:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 137 00000040:00080000:3.0:1789575601.577776:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575601.577788:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575601.579148:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789575601.579170:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789575601.581525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699366144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575601.581638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575601.581897:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366144 00000100:00100000:1.0:1789575601.581910:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366144 00000100:00100000:1.0:1789575601.582006:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789575601.582018:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699366144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789575601.582074:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789575601.582140:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699366144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575601.582148:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789575601.582316:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575601.582363:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699366144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575602.153538:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575602.602499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699366272:0@lo:400:kworker.0 00000100:00100000:0.0:1789575602.602603:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699366656:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.602624:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575602.602695:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575602.602728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699366784:0@lo:400:kworker.0 00000100:00100000:0.0:1789575602.602763:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575602.602788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575602.602793:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699366528:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.602831:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789575602.602841:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575602.602856:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699366400:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.604268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575602.604325:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699366912:0@lo:400:kworker.0 00000100:00100000:0.0:1789575602.604351:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366784 00000100:00100000:0.0:1789575602.604367:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366784 00000100:00100000:3.0:1789575602.604398:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575602.604475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366272 00000100:00100000:3.0:1789575602.604485:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366272 00000100:00100000:0.0:1789575602.604500:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366528 00000100:00100000:0.0:1789575602.604507:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366528 00000100:00100000:3.0:1789575602.604547:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789575602.604550:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366400 00000100:00100000:0.0:1789575602.604556:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366400 00000100:00100000:3.0:1789575602.604562:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699366272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575602.604583:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789575602.604597:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699366784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.604641:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699366272:12345-0@lo:400:kworker.0 Request processed in 82us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575602.604650:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789575602.604696:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699366784:12345-0@lo:400:kworker.0 Request processed in 98us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575602.604706:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366656 00000100:00100000:0.0:1789575602.604708:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789575602.604714:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366656 00000100:00100000:3.0:1789575602.604756:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699366912 00000100:00100000:3.0:1789575602.604760:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699366912 00000100:00100000:3.0:1789575602.604785:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789575602.604792:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699366656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.604840:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699366656:12345-0@lo:400:kworker.0 Request processed in 49us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575602.604846:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789575602.604858:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789575602.604864:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699366912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.604920:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699366912:12345-0@lo:400:kworker.0 Request processed in 48us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575602.604926:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789575602.606012:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789575602.606042:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699366528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606060:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789575602.606082:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699366400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575602.606124:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699366528:12345-0@lo:400:kworker.0 Request processed in 94us (3281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575602.606132:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1789575602.606171:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575602.606177:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575602.606306:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699366400:12345-0@lo:400:kworker.0 Request processed in 234us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575602.606314:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789575602.606512:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699366528:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606533:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699366656:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606590:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699366400:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699366912:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606617:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699366784:0@lo:400:kworker.0 00000100:00100000:3.0:1789575602.606628:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc416d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699366272:0@lo:400:kworker.0 00000100:00100000:2.0:1789575603.112856:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575603.112892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699367040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575603.113036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575603.113315:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699367040 00000100:00100000:0.0:1789575603.113327:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699367040 00000100:00100000:2.0:1789575603.115357:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789575603.115419:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699367040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575603.115473:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575603.115595:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc398e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699367040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 222us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575603.115602:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789575603.115923:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699367040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575603.176705:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789575603.624740:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575603.624757:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575603.625510:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789575603.625521:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789575603.748909:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.750182:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284288 00000100:00100000:3.0:1789575603.750197:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284288 00000100:00100000:3.0:1789575603.750288:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:3.0:1789575603.750299:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11341:x1876505676284288:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575603.750321:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575603.750356:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bd6 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750730:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750758:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750770:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750787:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750795:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.750802:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751008:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751016:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751024:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751030:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.751034:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751042:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751053:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:3.0:1789575603.751062:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.751068:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751074:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751085:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751091:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751097:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751102:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.751104:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751109:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751116:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575603.751119:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.751121:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751126:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383a9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751159:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bd6 expref: 15 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751179:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:3.0:1789575603.751181:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.751185:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383a8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bd6 expref: 15 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.751194:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0200, rc 0) 00000100:00100000:3.0:1789575603.751270:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc39b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11341:x1876505676284288:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 972us (2382us total) trans 0 rc 301/301 00000100:00100000:3.0:1789575603.751278:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00080000:1.0:1789575603.752482:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575603.767913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.768019:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284544 00000100:00100000:3.0:1789575603.768039:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284544 00000100:00100000:3.0:1789575603.768142:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:3.0:1789575603.768160:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11341:x1876505676284544:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:3.0:1789575603.768257:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575603.768297:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a2238341b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a16 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768325:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9683773800) 00010000:00010000:3.0:1789575603.768339:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575603.768732:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768753:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768768:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768795:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768802:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.768810:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575603.770357:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789575603.770417:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770431:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770442:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770452:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.770460:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770472:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770493:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575603.770498:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.770505:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.770527:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383aa4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575603.770554:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000732a45a1 reply state 000000001e6e0c92 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575603.770567:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575603.770735:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+15:11341:x1876505676284544:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 2575us (2838us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789575603.770750:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00010000:00010000:2.0:1789575603.775895:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775925:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775934:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775941:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575603.775946:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775953:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775970:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e9687bd8b00) 00010000:00010000:2.0:1789575603.775973:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575603.775977:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.775984:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383aab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575603.854823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.854947:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284672 00000100:00100000:3.0:1789575603.854966:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284672 00000100:00100000:3.0:1789575603.855060:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:3.0:1789575603.855077:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+14:11349:x1876505676284672:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:3.0:1789575603.855114:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575603.855150:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bdd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855272:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855295:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855309:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575603.855363:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789575603.855435:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575603.855493:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855528:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bdd expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855553:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bdd expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.855564:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575603.855567:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789575603.855573:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0a00, rc 0) 00000100:00100000:3.0:1789575603.855665:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+15:11349:x1876505676284672:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 595us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575603.855673:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:2.0:1789575603.913249:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.913349:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676284800 00000100:00100000:3.0:1789575603.913364:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676284800 00000100:00100000:3.0:1789575603.913471:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:3.0:1789575603.913484:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+15:11355:x1876505676284800:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575603.913513:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575603.913541:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383ac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5be4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913631:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913648:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913688:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913709:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913717:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.913725:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915448:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915476:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915492:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575603.915541:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789575603.915546:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575603.915569:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915586:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915713:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915745:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915751:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.915756:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915766:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915781:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575603.915785:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.915790:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915796:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915817:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915825:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915830:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915835:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.915838:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915854:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915864:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575603.915866:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.915869:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915875:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ace lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915935:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383ac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5be4 expref: 17 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915952:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5be4 expref: 16 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.915960:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575603.915962:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789575603.915964:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1200, rc 0) 00000100:00100000:3.0:1789575603.916070:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+16:11355:x1876505676284800:12345-192.168.202.32@tcp:101:bash.0 Request processed in 2587us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575603.916080:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:0.0:1789575603.919822:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.920209:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285056 00000100:00100000:3.0:1789575603.920235:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285056 00000100:00100000:3.0:1789575603.920317:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:3.0:1789575603.920330:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+16:11355:x1876505676285056:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575603.920772:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575603.920805:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383adc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5beb expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.921281:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.921301:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.921315:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.923130:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.923157:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.923171:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575603.924483:0:9231:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789575603.924766:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.924785:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.924798:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.924984:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.924995:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925074:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925082:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575603.925089:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925100:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925117:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575603.925120:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575603.925126:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925133:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383ae3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575603.925156:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076216ee0 reply state 00000000d131ed6a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575603.925168:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789575603.925295:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383adc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 19 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925331:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 18 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.925339:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575603.925342:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575603.925344:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575603.925643:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11355:x1876505676285056:12345-192.168.202.32@tcp:101:bash.0 Request processed in 5314us (5841us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789575603.925655:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 142 00010000:00010000:1.0:1789575603.928104:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928126:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928153:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928161:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575603.928166:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928176:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928196:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8f00) 00010000:00010000:1.0:1789575603.928200:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575603.928206:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575603.928213:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575603.932473:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.932837:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285184 00000100:00100000:3.0:1789575603.932855:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285184 00000100:00100000:3.0:1789575603.933088:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789575603.933105:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2356:x1876505676285184:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575603.933131:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575603.933162:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bf2 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575603.933206:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575603.933244:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=416s v=(0 0) 00010000:00010000:3.0:1789575603.933250:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575603.933263:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.933290:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.933332:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0200, rc 0) 00000100:00100000:3.0:1789575603.933596:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676285184:12345-192.168.202.32@tcp:101:bash.0 Request processed in 494us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575603.933604:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00080000:1.0:1789575603.933778:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575603.939885:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.940101:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285312 00000100:00100000:3.0:1789575603.940118:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285312 00000100:00100000:3.0:1789575603.940205:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:3.0:1789575603.940342:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:11355:x1876505676285312:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575603.940549:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575603.940666:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5bf9 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.940715:0:9232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.940727:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575603.940732:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575603.940739:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.940785:0:9232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575603.940803:0:9232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575603.940822:0:9232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc925880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9232:1876505699367168:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575603.941086:0:9232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bb78c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575603.944770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.944988:0:9232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc925880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9232:1876505699367168:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575603.945032:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 7 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575603.945062:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:3.0:1789575603.945159:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:11355:x1876505676285312:12345-192.168.202.32@tcp:101:bash.0 Request processed in 4943us (5359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575603.945170:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789575603.945534:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285440 00000100:00100000:0.0:1789575603.945545:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285440 00010000:00010000:0.0:1789575603.945605:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575603.945645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:0.0:1789575603.945656:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676285440:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575603.945673:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575603.945701:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575603.945716:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575603.945746:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d603deb9/0xc45cc82a22383aff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf2 expref: 7 pid: 6709 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575603.945763:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575603.945768:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575603.945778:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575603.945788:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575603.945827:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575603.945856:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1876505699367296:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789575603.945940:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575603.949666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575603.949845:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285696 00000100:00100000:3.0:1789575603.949860:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285696 00000100:00100000:3.0:1789575603.949961:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789575603.949973:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11355:x1876505676285696:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789575603.955887:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1876505699367296:192.168.202.32@tcp:105: 00010000:00010000:3.0:1789575603.955933:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575603.956055:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676285440:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 10399us (11298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575603.956069:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789575603.959337:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11355:x1876505676285696:12345-192.168.202.32@tcp:35:bash.0 Request processed in 9349us (9671us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789575603.959355:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789575604.076837:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.076944:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676285952 00000100:00100000:3.0:1789575604.076960:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676285952 00000100:00100000:3.0:1789575604.077050:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:3.0:1789575604.077062:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11365:x1876505676285952:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575604.077247:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575604.077274:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c00 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575604.077462:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789575604.077826:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c00 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.077847:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:3.0:1789575604.077850:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575604.077857:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c00 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.077877:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575604.078188:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11365:x1876505676285952:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1018us (1257us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789575604.078197:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:0.0:1789575604.086779:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.089786:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676286208 00000100:00100000:1.0:1789575604.089811:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676286208 00000100:00100000:1.0:1789575604.089997:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:1.0:1789575604.090021:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11365:x1876505676286208:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789575604.091702:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+21:11365:x1876505676286208:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1674us (4927us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789575604.091716:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:1.0:1789575604.199010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.199175:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676286336 00000100:00100000:0.0:1789575604.199195:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676286336 00000100:00100000:0.0:1789575604.199277:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00100000:0.0:1789575604.199291:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+21:11371:x1876505676286336:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575604.199326:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575604.199358:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c07 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199484:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199517:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199534:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575604.199591:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789575604.199597:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575604.199624:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199662:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c07 expref: 23 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199706:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c07 expref: 22 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.199717:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575604.199721:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575604.199726:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:0.0:1789575604.199815:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+22:11371:x1876505676286336:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 526us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575604.199824:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 144 00010000:00010000:3.0:1789575604.203247:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575604.209316:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.210026:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676286592 00000100:00100000:3.0:1789575604.210048:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676286592 00000100:00100000:3.0:1789575604.210145:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:3.0:1789575604.210169:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+22:11371:x1876505676286592:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575604.210208:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575604.210242:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c0e expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.210452:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383b30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.210472:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.210487:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383b30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575604.211992:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789575604.212363:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c0e expref: 25 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.214351:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383b30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c0e expref: 24 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.214364:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575604.214368:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575604.214394:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575604.215115:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+24:11371:x1876505676286592:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4946us (5813us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789575604.215127:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:1.0:1789575604.235041:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.235700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.235950:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676286976 00000100:00100000:0.0:1789575604.235967:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676286976 00000100:00100000:0.0:1789575604.236043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789575604.236055:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+24:2356:x1876505676286976:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575604.236071:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575604.237359:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383b30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c0e expref: 24 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.237399:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:0.0:1789575604.237404:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575604.237483:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:2356:x1876505676286976:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1428us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575604.237492:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789575604.241914:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676286848 00000100:00100000:3.0:1789575604.241940:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676286848 00000100:00100000:3.0:1789575604.242071:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 146 00000100:00100000:3.0:1789575604.242084:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:11371:x1876505676286848:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575604.242119:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575604.242150:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c15 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.242306:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.242325:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.242341:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575604.242358:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789575604.242769:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c15 expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.242798:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c15 expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.242809:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:3.0:1789575604.242812:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789575604.242818:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0200, rc 0) 00000100:00100000:3.0:1789575604.242946:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+25:11371:x1876505676286848:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 864us (7922us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789575604.242955:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 146 00000100:00100000:1.0:1789575604.253480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.253685:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287104 00000100:00100000:3.0:1789575604.253718:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287104 00000100:00100000:3.0:1789575604.253794:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789575604.253805:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2358:x1876505676287104:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:3.0:1789575604.253875:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.253913:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.253925:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575604.253931:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575604.253936:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.253990:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.254010:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 6 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575604.254033:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699367424:192.168.202.32@tcp:104: 00000001:00080000:0.0:1789575604.254069:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000100:00100000:3.0:1789575604.257126:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789575604.260949:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699367424:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575604.260997:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575604.261909:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.262150:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287232 00000100:00100000:3.0:1789575604.262162:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287232 00002000:00100000:3.0:1789575604.262241:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e96bb257b80 x1876505676287232/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:625/0 lens 504/0 e 0 to 0 dl 1789575615 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575604.262253:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bb257b80 with x1876505676287232 ext(0->12) 00010000:00010000:3.0:1789575604.262262:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 7 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.262281:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 7 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575604.262290:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bb257b80 00000100:00100000:3.0:1789575604.262333:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:3.0:1789575604.262345:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676287232:12345-192.168.202.32@tcp:4:lfs.0 00000100:00100000:3.0:1789575604.264144:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676287232:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 1780us (2230us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789575604.264163:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00002000:00100000:3.0:1789575604.264179:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e96bb257b80 x1876505676287232/t4294967305(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:625/0 lens 504/448 e 0 to 0 dl 1789575615 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575604.264192:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bb257b80 with x1876505676287232 ext(0->12) 00010000:00010000:3.0:1789575604.264206:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.264265:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575604.264276:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e96bb257b80 00000100:00100000:2.0:1789575604.273811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.273964:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287360 00000100:00100000:3.0:1789575604.273980:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287360 00010000:00010000:3.0:1789575604.274039:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575604.274165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:3.0:1789575604.274180:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2356:x1876505676287360:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575604.274202:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789575604.274231:0:5848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789575604.274235:0:5848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789575604 00002000:00010000:3.0:1789575604.274238:0:5848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789575604 00002000:00010000:3.0:1789575604.274240:0:5848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789575604 00010000:00010000:3.0:1789575604.274248:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.274264:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.274293:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f641541/0xc45cc82a22383b06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bf9 expref: 9 pid: 9232 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.274345:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575604.274352:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575604.274359:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.274436:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.274481:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575604.274563:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2356:x1876505676287360:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 386us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575604.274572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00010000:00010000:2.0:1789575604.278227:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278257:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278316:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278326:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278336:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278344:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575604.278348:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278359:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278445:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.278455:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a7070ed/0xc45cc82a22383b53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575604.278675:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676287104:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 24860us (25200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575604.278692:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789575604.289710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.289902:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287616 00000100:00100000:0.0:1789575604.289937:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287616 00000100:00100000:1.0:1789575604.290101:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789575604.290119:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11371:x1876505676287616:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:1.0:1789575604.290213:0:5866:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c15 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575604.290865:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789575604.290934:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789575604.295294:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789575604.295485:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.300839:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 23 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.301655:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.301750:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 23 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.301772:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 23 pid: 9231 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575604.301793:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb256a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5866:1876505699367552:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575604.303157:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575604.316359:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb256a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5866:1876505699367552:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575604.316645:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575604.319229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.319483:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287744 00000100:00100000:0.0:1789575604.319500:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287744 00010000:00010000:0.0:1789575604.319646:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 24 pid: 9231 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575604.319770:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:0.0:1789575604.319782:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+24:2358:x1876505676287744:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575604.319806:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575604.319815:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 24 pid: 9231 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319833:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 24 pid: 9231 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319881:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383af1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5beb expref: 24 pid: 9231 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319915:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:0.0:1789575604.319922:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319936:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319946:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.319986:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575604.320072:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:2358:x1876505676287744:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 291us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575604.320099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00010000:00010000:2.0:1789575604.320170:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575604.320180:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575604.320447:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789575604.320789:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1789575604.320959:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699367680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789575604.321049:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575604.321104:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bb78c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575604.322027:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699367680 00000100:00100000:3.0:1789575604.322050:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699367680 00000100:00100000:3.0:1789575604.322487:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789575604.322502:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5866:x1876505699367680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789575604.322641:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5866:x1876505699367680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575604.322649:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789575604.322719:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc926a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699367680:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1789575604.324447:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789575604.324658:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789575604.324779:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699367808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789575604.324853:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575604.324916:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575604.326490:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699367808 00000100:00100000:2.0:1789575604.326520:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699367808 00000100:00100000:3.0:1789575604.326664:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789575604.326678:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5866:x1876505699367808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789575604.327010:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5866:x1876505699367808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 335us (2156us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789575604.327019:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575604.327714:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699367808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789575604.327838:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789575604.328356:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328405:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328416:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328423:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.328431:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328442:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328464:0:5866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:1.0:1789575604.328468:0:5866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789575604.328474:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.328481:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789575604.329326:0:5866:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789575604.329757:0:5866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789575604.329774:0:5866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416416401822ns, next at 417416398592ns, rc = 0 00000001:00080000:1.0:1789575604.329784:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789575604.329846:0:5866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8d00) 00010000:00010000:1.0:1789575604.329852:0:5866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789575604.330003:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383b45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c15 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575604.330223:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11371:x1876505676287616:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 40108us (40534us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789575604.330235:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000020:00080000:1.0:1789575604.330243:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789575604.334809:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.334904:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676287872 00000100:00100000:1.0:1789575604.334927:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676287872 00000100:00100000:1.0:1789575604.335031:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:1.0:1789575604.335051:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11371:x1876505676287872:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575604.335088:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575604.335120:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c1c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.335212:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c1c expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.335231:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383b61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c1c expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.335255:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575604.335258:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575604.335264:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1600, rc 0) 00000100:00100000:1.0:1789575604.335361:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:11371:x1876505676287872:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 316us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575604.335622:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:3.0:1789575604.340888:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575604.341022:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676288128 00000100:00100000:2.0:1789575604.341049:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676288128 00000100:00100000:2.0:1789575604.341161:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789575604.341174:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:11371:x1876505676288128:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575604.341867:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11371:x1876505676288128:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 688us (981us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789575604.341877:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789575604.413926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.414138:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676288384 00000100:00100000:0.0:1789575604.414153:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676288384 00000100:00100000:0.0:1789575604.414231:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:0.0:1789575604.414244:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11381:x1876505676288384:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575604.414280:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575604.414306:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c23 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575604.414742:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789575604.414928:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383b68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c23 expref: 30 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.414949:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:0.0:1789575604.414952:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575604.414960:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c23 expref: 30 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.414982:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575604.415122:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11381:x1876505676288384:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 879us (1210us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789575604.415130:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:2.0:1789575604.429796:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.429878:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676288512 00000100:00100000:1.0:1789575604.429921:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676288512 00000100:00100000:1.0:1789575604.429988:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:1.0:1789575604.429998:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11381:x1876505676288512:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:1.0:1789575604.430115:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430141:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430155:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430171:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430178:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430186:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430516:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430525:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430532:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789575604.430578:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430601:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430608:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430616:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430623:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.430627:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430635:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430646:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575604.430650:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575604.430655:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430662:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430684:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430691:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430697:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430708:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.430711:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430718:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430726:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575604.430728:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575604.430731:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430737:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430759:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430766:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430772:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430777:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.430780:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430786:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430800:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575604.430803:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575604.430806:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.430812:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575604.430905:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11381:x1876505676288512:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 899us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575604.430915:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:1.0:1789575604.436048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.436172:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676288768 00000100:00100000:3.0:1789575604.436186:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676288768 00000100:00100000:3.0:1789575604.436277:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789575604.436291:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11381:x1876505676288768:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575604.437583:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+30:11381:x1876505676288768:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1280us (1534us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789575604.437597:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789575604.523074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.523151:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676289024 00000100:00100000:1.0:1789575604.523164:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676289024 00000100:00100000:1.0:1789575604.523281:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:1.0:1789575604.523292:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+30:11384:x1876505676289024:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575604.523321:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575604.523342:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c2a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523491:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523517:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523531:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523571:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523579:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523587:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523916:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523926:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.523934:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575604.523945:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789575604.524041:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524049:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524057:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524065:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.524070:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524092:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524105:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575604.524109:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575604.524114:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524121:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383b92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524135:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524140:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524146:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524151:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575604.524154:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524159:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524165:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575604.524167:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575604.524170:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524183:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524224:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383b8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524236:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.524243:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575604.524246:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575604.524248:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:1.0:1789575604.524318:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11384:x1876505676289024:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1027us (1259us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789575604.524326:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:2.0:1789575604.535546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575604.535926:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676289152 00000100:00100000:3.0:1789575604.535938:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676289152 00000100:00100000:3.0:1789575604.536017:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:3.0:1789575604.536029:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11384:x1876505676289152:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789575604.536123:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.536147:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.536179:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538308:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538326:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538334:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538340:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575604.538346:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538356:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538454:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575604.538458:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575604.538464:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575604.538471:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575604.538635:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11384:x1876505676289152:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 2603us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575604.538645:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:1.0:1789575604.548044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.548145:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676289408 00000100:00100000:0.0:1789575604.548155:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676289408 00000100:00100000:0.0:1789575604.548207:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789575604.548216:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11384:x1876505676289408:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789575604.548485:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+33:11384:x1876505676289408:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 269us (452us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789575604.548493:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:2.0:1789575604.958946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.959136:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676289664 00000100:00100000:1.0:1789575604.959151:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676289664 00000100:00100000:1.0:1789575604.959310:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:1.0:1789575604.959321:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+33:11415:x1876505676289664:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789575604.959348:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575604.959571:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c31 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.959687:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.959719:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.959731:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575604.959742:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789575604.959874:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c31 expref: 36 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.959909:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c31 expref: 35 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575604.959916:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575604.959918:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575604.959922:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:1.0:1789575604.959996:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11415:x1876505676289664:12345-192.168.202.32@tcp:101:cat.0 Request processed in 677us (1062us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789575604.960002:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:2.0:1789575604.964468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575604.964675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676289792 00000100:00100000:0.0:1789575604.964689:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676289792 00000100:00100000:0.0:1789575604.964757:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789575604.964766:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+35:2355:x1876505676289792:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575604.964780:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575604.964803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c31 expref: 35 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575604.964819:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:0.0:1789575604.964823:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575604.964873:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+34:2355:x1876505676289792:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 108us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575604.964885:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789575604.967003:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575604.967215:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676290048 00000100:00100000:1.0:1789575604.967228:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676290048 00000100:00100000:0.0:1789575604.967595:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789575604.967609:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+34:11415:x1876505676290048:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:0.0:1789575604.967883:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11415:x1876505676290048:12345-192.168.202.32@tcp:35:cat.0 Request processed in 277us (892us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789575604.967903:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:2.0:1789575605.029068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.029131:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676290304 00000100:00100000:1.0:1789575605.029142:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676290304 00000100:00080000:2.0:1789575605.029473:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575605.029689:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:3.0:1789575605.029702:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11421:x1876505676290304:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:3.0:1789575605.029729:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575605.029732:0:7184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789575605.029763:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c07 expref: 35 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.029782:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575605.029785:0:7184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575605.029800:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c38 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.029921:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.029938:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.029947:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.029989:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.030004:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 35 pid: 5862 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.030020:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586829880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699367936:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575605.030297:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575605.033744:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586829880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699367936:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575605.033775:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575605.034589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.034752:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676290432 00000100:00100000:1.0:1789575605.034760:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676290432 00010000:00010000:1.0:1789575605.034794:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 36 pid: 5862 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.034826:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:1.0:1789575605.034844:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+36:2358:x1876505676290432:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575605.034858:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575605.034863:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 36 pid: 5862 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.034872:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 36 pid: 5862 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.034900:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c2a expref: 36 pid: 5862 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.034919:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.034925:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.034935:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.034942:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.035312:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575605.035417:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:2358:x1876505676290432:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 570us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575605.035426:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00010000:00010000:3.0:1789575605.036603:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.036620:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575605.036651:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789575605.036838:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383bca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 36 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.036856:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 35 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.036863:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575605.036865:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789575605.036867:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575605.036987:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11421:x1876505676290304:12345-192.168.202.32@tcp:101:dd.0 Request processed in 7288us (7928us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789575605.036995:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:2.0:1789575605.039790:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575605.039878:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676290688 00000100:00100000:3.0:1789575605.039895:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676290688 00000100:00100000:3.0:1789575605.039952:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:3.0:1789575605.039960:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11421:x1876505676290688:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:3.0:1789575605.040258:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.040272:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.040282:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575605.040322:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789575605.040341:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0189a3f reply state 00000000aab75210 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.040347:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575605.040703:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11421:x1876505676290688:12345-192.168.202.32@tcp:36:dd.0 Request processed in 742us (920us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789575605.040708:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 154 00000020:00080000:3.0:1789575605.040712:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789575605.045937:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.045961:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.045971:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.045977:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575605.045983:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.045991:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.046032:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575605.046035:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575605.046041:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.046047:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383bdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.227272:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575605.324939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.325048:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676290816 00000100:00100000:1.0:1789575605.325062:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676290816 00000100:00100000:1.0:1789575605.325142:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00100000:1.0:1789575605.325153:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+37:11435:x1876505676290816:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:1.0:1789575605.325189:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.325213:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383be6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c3f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325283:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325299:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325311:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325326:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325332:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325339:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325620:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325632:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 38 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325640:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325673:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 38 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.325693:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 38 pid: 7184 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.325708:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699368064:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575605.325871:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789575605.334733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575605.334851:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676291072 00000100:00100000:3.0:1789575605.334865:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676291072 00000100:00100000:3.0:1789575605.334944:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:3.0:1789575605.334957:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+39:5599:x1876505676291072:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789575605.335112:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699368064:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575605.335155:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.336005:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+40:5599:x1876505676291072:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 1048us (1281us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789575605.336015:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:3.0:1789575605.339264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575605.339659:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676291200 00000100:00100000:0.0:1789575605.339671:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676291200 00010000:00010000:0.0:1789575605.339742:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 40 pid: 7184 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575605.339840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:0.0:1789575605.339853:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0e30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+40:2358:x1876505676291200:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575605.339873:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575605.339881:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 40 pid: 7184 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.339907:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 40 pid: 7184 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.339932:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383bd1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c38 expref: 40 pid: 7184 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.339949:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:0.0:1789575605.339954:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.339963:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.339971:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.340007:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575605.340066:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0e30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+39:2358:x1876505676291200:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 215us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575605.340074:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00010000:00010000:1.0:1789575605.340171:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340179:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.340750:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789575605.340757:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575605.340785:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340817:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340827:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340834:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340856:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340862:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575605.340867:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340875:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340895:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575605.340898:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575605.340902:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340909:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383bed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340923:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340930:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340935:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340940:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575605.340943:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340961:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340970:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575605.340972:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575605.340975:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.340982:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383bf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.341019:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383be6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c3f expref: 39 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.341032:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c3f expref: 38 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.341040:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.341042:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575605.341044:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:1.0:1789575605.341101:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11435:x1876505676290816:12345-192.168.202.32@tcp:101:stat.0 Request processed in 15949us (16176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575605.341109:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00100000:3.0:1789575605.414102:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575605.414296:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676291456 00000100:00100000:2.0:1789575605.414311:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676291456 00000100:00100000:2.0:1789575605.414441:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 156 00000100:00100000:2.0:1789575605.414452:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11441:x1876505676291456:12345-192.168.202.32@tcp:36:truncate.0 00010000:00010000:2.0:1789575605.414525:0:7184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575605.414561:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383bfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c3f expref: 38 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.414586:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:2.0:1789575605.414592:0:7184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575605.414861:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.414879:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.414904:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575605.414993:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1789575605.415019:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036efa3be reply state 000000000c08d7dd transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575605.415029:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575605.415152:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+40:11441:x1876505676291456:12345-192.168.202.32@tcp:36:truncate.0 Request processed in 699us (1071us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789575605.415160:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 156 00000020:00080000:2.0:1789575605.415166:0:7184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575605.426590:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426616:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426657:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426663:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575605.426671:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426679:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426703:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.426707:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575605.426712:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.426720:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383c02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.584813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575605.585085:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676291584 00000100:00100000:0.0:1789575605.585115:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676291584 00000100:00100000:0.0:1789575605.585197:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 157 00000100:00100000:0.0:1789575605.585218:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+39:11455:x1876505676291584:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:0.0:1789575605.585250:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575605.585276:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383c09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c46 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585426:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585444:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585458:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585475:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585482:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.585490:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.586993:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587009:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587019:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575605.587070:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789575605.587074:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575605.587094:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587107:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587116:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587123:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587131:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587137:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575605.587142:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587149:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587161:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575605.587164:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575605.587169:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.587175:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383c10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589222:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589243:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589251:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589258:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575605.589264:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589273:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589290:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575605.589293:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575605.589299:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589305:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589387:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383c09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589404:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.589427:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:0.0:1789575605.589429:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575605.589431:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575605.589673:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+40:11455:x1876505676291584:12345-192.168.202.32@tcp:101:stat.0 Request processed in 4454us (4872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575605.589684:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 157 00000100:00100000:2.0:1789575605.675961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.676163:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676291840 00000100:00100000:1.0:1789575605.676176:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676291840 00000100:00100000:1.0:1789575605.676341:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:1.0:1789575605.676354:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+40:11465:x1876505676291840:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575605.676898:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.676933:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c4d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.677166:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789575605.677565:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c4d expref: 42 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.677601:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:1.0:1789575605.677604:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575605.677611:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c4d expref: 42 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.677626:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575605.677705:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+41:11465:x1876505676291840:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1352us (1824us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789575605.677715:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:1.0:1789575605.682491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575605.682648:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292096 00000100:00100000:0.0:1789575605.682661:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292096 00000100:00100000:0.0:1789575605.682739:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:0.0:1789575605.682750:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+41:11465:x1876505676292096:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789575605.683269:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+42:11465:x1876505676292096:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 519us (789us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789575605.683277:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789575605.762188:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.762503:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292352 00000100:00100000:1.0:1789575605.762514:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292352 00000100:00100000:1.0:1789575605.762719:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:1.0:1789575605.762731:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+42:11471:x1876505676292352:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789575605.762758:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.762782:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c54 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.762926:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.762946:0:9231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.762956:0:9231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.763021:0:9231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.763038:0:9231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 43 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.763054:0:9231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699368192:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575605.763189:0:9231:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575605.766553:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575605.766730:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292480 00000100:00100000:0.0:1789575605.766740:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292480 00010000:00010000:0.0:1789575605.766787:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 44 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575605.766836:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:0.0:1789575605.766846:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+44:2358:x1876505676292480:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575605.766863:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575605.766871:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 44 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.766896:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 44 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.766946:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:0.0:1789575605.766954:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.766965:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.766973:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575605.766997:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575605.767051:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+44:2358:x1876505676292480:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 207us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575605.767058:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00010000:00010000:1.0:1789575605.767308:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383c1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c46 expref: 43 pid: 5863 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.767329:0:9231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9231:1876505699368192:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575605.767352:0:9231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.767428:0:9231:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.767436:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.767464:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789575605.767686:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 44 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.767705:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 43 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.767730:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.767732:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789575605.767736:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0600, rc 0) 00000100:00100000:1.0:1789575605.767775:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+43:11471:x1876505676292352:12345-192.168.202.32@tcp:101:bash.0 Request processed in 5046us (5599us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789575605.767782:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:0.0:1789575605.773240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575605.776083:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292736 00000100:00100000:3.0:1789575605.776116:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292736 00000100:00100000:3.0:1789575605.776528:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 160 00000100:00100000:3.0:1789575605.776543:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+43:11471:x1876505676292736:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789575605.776897:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.776934:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.776946:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575605.776998:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789575605.777024:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfb8cc13 reply state 00000000878cdbdc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.777034:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575605.777330:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+46:11471:x1876505676292736:12345-192.168.202.32@tcp:36:bash.0 Request processed in 788us (4099us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789575605.777338:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 160 00000020:00080000:3.0:1789575605.777343:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789575605.779522:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779541:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779550:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779554:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575605.779567:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779576:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779633:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:2.0:1789575605.779640:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575605.779645:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.779670:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383c48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575605.782904:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.783011:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292864 00000100:00100000:1.0:1789575605.783021:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292864 00000100:00100000:1.0:1789575605.783072:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:1.0:1789575605.783080:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:11471:x1876505676292864:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789575605.783105:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.783129:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c5b expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.783347:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.783535:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 46 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.783545:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.783583:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 46 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.783597:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 46 pid: 9231 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.783619:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699368320:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575605.783689:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789575605.787053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575605.788257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676292992 00000100:00100000:3.0:1789575605.788275:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676292992 00010000:00010000:3.0:1789575605.788341:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 47 pid: 9231 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.788431:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:3.0:1789575605.788443:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+47:2358:x1876505676292992:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575605.788459:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575605.788466:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 47 pid: 9231 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.788492:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 47 pid: 9231 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.788535:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575605.788540:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.788551:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.788559:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.788580:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575605.788656:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+47:2358:x1876505676292992:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 215us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575605.788664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00010000:00010000:1.0:1789575605.794155:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c54 expref: 46 pid: 9231 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575605.794190:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699368320:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575605.794221:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.794234:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.794240:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.794297:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789575605.794302:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575605.794329:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.794457:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c5b expref: 46 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.794473:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c5b expref: 45 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.794484:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.794539:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575605.794549:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:1.0:1789575605.794680:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:11471:x1876505676292864:12345-192.168.202.32@tcp:101:bash.0 Request processed in 11595us (11793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575605.794695:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:0.0:1789575605.799487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575605.799827:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676293248 00000100:00100000:3.0:1789575605.799840:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676293248 00000100:00100000:3.0:1789575605.799967:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:3.0:1789575605.799980:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+45:11471:x1876505676293248:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789575605.800301:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+46:11471:x1876505676293248:12345-192.168.202.32@tcp:35:bash.0 Request processed in 323us (836us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789575605.800309:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:3.0:1789575605.870552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.871048:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676293504 00000100:00100000:1.0:1789575605.871064:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676293504 00000100:00100000:1.0:1789575605.871248:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:1.0:1789575605.871272:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+46:11481:x1876505676293504:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575605.871306:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.871334:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c62 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.871516:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789575605.871701:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c62 expref: 48 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.871717:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:1.0:1789575605.871720:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575605.871726:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c62 expref: 48 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.871742:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575605.871819:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+47:11481:x1876505676293504:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 560us (1281us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789575605.871828:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:3.0:1789575605.875905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575605.876940:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676293632 00000100:00100000:2.0:1789575605.876956:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676293632 00000100:00100000:2.0:1789575605.877012:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:2.0:1789575605.877022:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+47:11481:x1876505676293632:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789575605.877130:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.877151:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.877164:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.877183:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.877191:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.877197:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878263:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878277:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878298:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575605.878351:0:7184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878366:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878388:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878395:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878401:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575605.878405:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878413:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878425:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575605.878428:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575605.878433:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878439:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383c6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878451:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878463:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878469:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878473:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575605.878476:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878483:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878492:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9683773c00) 00010000:00010000:2.0:1789575605.878494:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575605.878497:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878502:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878516:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878523:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878528:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878533:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575605.878542:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878549:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878557:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:2.0:1789575605.878559:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575605.878562:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575605.878568:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383c79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575605.879646:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+47:11481:x1876505676293632:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 2619us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575605.879656:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:0.0:1789575605.883214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.883491:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676293888 00000100:00100000:1.0:1789575605.883521:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676293888 00000100:00100000:1.0:1789575605.883590:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:1.0:1789575605.883608:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+47:11481:x1876505676293888:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789575605.883859:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+48:11481:x1876505676293888:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 253us (667us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789575605.883867:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789575605.965930:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.971017:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676294144 00000100:00100000:1.0:1789575605.971036:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676294144 00000100:00100000:1.0:1789575605.971110:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:1.0:1789575605.971121:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+48:11485:x1876505676294144:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575605.971148:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575605.971171:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c69 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971246:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971261:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971274:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971289:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971295:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971302:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971617:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971627:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971634:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575605.971644:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789575605.971741:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971748:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971755:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971761:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575605.971766:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971774:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971786:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575605.971788:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575605.971908:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971926:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383c87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971941:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971947:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971952:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971957:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575605.971960:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971966:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971973:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575605.971976:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575605.971978:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.971983:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383c8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.972029:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383c80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c69 expref: 51 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.972043:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c69 expref: 50 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.972056:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.972058:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575605.972061:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:1.0:1789575605.972144:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+50:11485:x1876505676294144:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1024us (6224us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789575605.972152:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:0.0:1789575605.981540:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575605.981588:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575605.981691:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676294400 00000100:00100000:1.0:1789575605.981702:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676294400 00000100:00100000:1.0:1789575605.981793:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:1.0:1789575605.981805:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+50:2357:x1876505676294400:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575605.981852:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575605.981891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c69 expref: 50 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575605.981913:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:1.0:1789575605.981920:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575605.981986:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:2357:x1876505676294400:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 184us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575605.981994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789575605.982586:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676294272 00000100:00100000:3.0:1789575605.982593:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676294272 00000100:00100000:3.0:1789575605.982636:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:3.0:1789575605.982652:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:11485:x1876505676294272:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789575605.982727:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982742:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982755:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982781:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982788:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982795:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982800:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575605.982804:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982812:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982820:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575605.982823:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575605.982826:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575605.982831:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575605.982902:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:11485:x1876505676294272:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 251us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575605.982909:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:0.0:1789575606.002975:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.003079:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676294656 00000100:00100000:1.0:1789575606.003090:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676294656 00000100:00100000:1.0:1789575606.003193:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:1.0:1789575606.003212:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:11485:x1876505676294656:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789575606.003513:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+50:11485:x1876505676294656:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 310us (547us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789575606.003535:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00010000:00010000:2.0:1789575606.249684:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575606.267786:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.268691:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676294912 00000100:00100000:2.0:1789575606.268706:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676294912 00000100:00100000:2.0:1789575606.268789:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:2.0:1789575606.268799:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+50:11503:x1876505676294912:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789575606.268824:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575606.268848:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c70 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.268983:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383cb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.269001:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.269036:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575606.269051:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789575606.269765:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c70 expref: 53 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.269786:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c70 expref: 52 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.269795:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:2.0:1789575606.269798:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789575606.269802:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9000, rc 0) 00000100:00100000:2.0:1789575606.269873:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11503:x1876505676294912:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1075us (2100us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789575606.269890:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:0.0:1789575606.324364:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.324824:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295040 00000100:00100000:1.0:1789575606.324835:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295040 00000100:00100000:1.0:1789575606.324908:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:1.0:1789575606.324919:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11504:x1876505676295040:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575606.324945:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575606.324967:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383cbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c77 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325035:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325049:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325059:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575606.325093:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789575606.325097:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575606.325114:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325213:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c77 expref: 54 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325231:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c77 expref: 53 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.325257:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575606.325260:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789575606.325264:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575606.325332:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11504:x1876505676295040:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 415us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.325340:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:0.0:1789575606.334325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.334433:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295424 00000100:00100000:3.0:1789575606.334444:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295424 00000100:00100000:3.0:1789575606.334499:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789575606.334511:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11504:x1876505676295424:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575606.334816:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11504:x1876505676295424:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 306us (501us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789575606.334824:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789575606.338550:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.338640:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295552 00000100:00100000:3.0:1789575606.338654:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295552 00000100:00100000:3.0:1789575606.338745:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575606.338757:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11504:x1876505676295552:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:3.0:1789575606.338773:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789575606.338799:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c5b expref: 54 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.338825:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c70 expref: 53 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.338839:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c1c expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.338849:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1300) 00010000:00010000:3.0:1789575606.338874:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575606.338948:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11504:x1876505676295552:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 194us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.338956:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789575606.342289:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.342588:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295680 00000100:00100000:2.0:1789575606.342601:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295680 00000100:00100000:2.0:1789575606.342699:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:2.0:1789575606.342712:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11504:x1876505676295680:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:2.0:1789575606.342869:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.342897:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.342911:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575606.343737:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789575606.343846:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11504:x1876505676295680:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 1134us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575606.343855:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:2.0:1789575606.385682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.385801:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295808 00000100:00100000:1.0:1789575606.385819:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295808 00000100:00100000:1.0:1789575606.385970:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:1.0:1789575606.385982:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11506:x1876505676295808:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575606.386008:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575606.386043:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383cd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c7e expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386130:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386147:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386159:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386175:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386183:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386209:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386535:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386546:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386555:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575606.386601:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789575606.386606:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575606.386631:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386644:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386654:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386662:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386671:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386678:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.386685:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386706:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386722:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575606.386725:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575606.386732:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386738:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386752:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386758:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386765:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386770:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.386774:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386780:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386788:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575606.386792:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575606.386795:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386811:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383ce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386850:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383cd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 53 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386865:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 52 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.386873:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:1.0:1789575606.386890:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789575606.386893:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1600, rc 0) 00000100:00100000:1.0:1789575606.387269:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11506:x1876505676295808:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1286us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.387279:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:0.0:1789575606.419142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.419211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.419258:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.419307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.419348:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296320 00000100:00100000:0.0:1789575606.419368:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296320 00000100:00100000:2.0:1789575606.419440:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676295936 00000100:00080000:0.0:1789575606.419454:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575606.419457:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676295936 00000100:00100000:0.0:1789575606.419522:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 177 00000100:00100000:2.0:1789575606.419537:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 304 00000100:00100000:0.0:1789575606.419540:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676296320:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575606.419555:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676295936:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575606.419639:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2356:x1876505676296320:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 105us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.419648:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 177 00000100:00100000:3.0:1789575606.419687:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296192 00000100:00100000:3.0:1789575606.419694:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296192 00000100:00100000:3.0:1789575606.419756:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296064 00000100:00100000:3.0:1789575606.419761:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296064 00000100:00100000:3.0:1789575606.419806:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:3.0:1789575606.419815:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676296192:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575606.419863:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:1.0:1789575606.419887:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676296064:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575606.425432:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2356:x1876505676295936:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 5862us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575606.425455:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 304 00000100:00080000:2.0:1789575606.425586:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575606.425596:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575606.426542:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2356:x1876505676296192:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 6722us (7324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.426558:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:1.0:1789575606.429420:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676296064:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 9532us (10146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.429435:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000040:00080000:3.0:1789575606.696718:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789575606.696726:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789575606.696766:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789575606.696772:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575606.696940:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586828000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699368448:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575606.697044:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5900 going to sleep for 11 seconds 00000004:00080000:1.0:1789575606.697868:0:6804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418784495916ns, next at 419784493794ns, rc = 0 00000100:00100000:1.0:1789575606.697902:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575606.697923:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789575606.697987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575606.698096:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699368576 00000100:00100000:0.0:1789575606.698105:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699368576 00000100:00100000:0.0:1789575606.698183:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789575606.698195:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699368576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575606.698233:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575606.698291:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699368576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.698299:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789575606.698363:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789575606.698465:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575606.700278:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586828000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699368448:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789575606.705980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.706186:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296448 00000100:00100000:1.0:1789575606.706207:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296448 00000100:00100000:1.0:1789575606.706269:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 170 00000100:00100000:1.0:1789575606.706281:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11517:x1876505676296448:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789575606.706318:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789575606.706470:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11517:x1876505676296448:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 191us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.706477:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 170 00000100:00100000:0.0:1789575606.713710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.713792:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296576 00000100:00100000:1.0:1789575606.713803:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296576 00000100:00100000:1.0:1789575606.713863:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:1.0:1789575606.713884:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11517:x1876505676296576:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789575606.713969:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.713988:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714002:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714017:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714023:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714029:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714072:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714081:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714087:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575606.714130:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789575606.714135:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575606.714149:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714160:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714167:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714175:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714182:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.714187:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714195:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714207:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:1.0:1789575606.714216:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575606.714222:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714228:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383cf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714240:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714246:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714253:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714257:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.714260:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714265:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714272:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575606.714275:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575606.714278:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714284:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383cf7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714297:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714309:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714314:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714319:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.714322:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714328:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714335:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:1.0:1789575606.714338:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575606.714340:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.714346:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575606.714461:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11517:x1876505676296576:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 588us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.714470:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:1.0:1789575606.719737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.719934:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296832 00000100:00100000:2.0:1789575606.719950:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296832 00000100:00100000:2.0:1789575606.720031:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:2.0:1789575606.720043:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11517:x1876505676296832:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575606.720075:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575606.720277:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c85 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721310:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721514:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721529:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575606.721541:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789575606.721642:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721649:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721656:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721662:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575606.721666:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721674:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721687:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:2.0:1789575606.721690:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575606.721695:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721702:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721746:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d05 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c85 expref: 54 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721764:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575606.721766:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575606.721770:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c85 expref: 54 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.721779:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575606.721952:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676296832:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1910us (2224us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789575606.721962:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:0.0:1789575606.730699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.731974:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676296960 00000100:00100000:3.0:1789575606.731990:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676296960 00000100:00100000:3.0:1789575606.732057:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:3.0:1789575606.732069:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676296960:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789575606.732551:0:9231:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789575606.732722:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676296960:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 653us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.732730:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:2.0:1789575606.740448:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.740680:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676297216 00000100:00100000:3.0:1789575606.740692:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676297216 00000100:00100000:3.0:1789575606.740752:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:3.0:1789575606.740762:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676297216:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575606.740790:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575606.740795:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789575606.740827:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c77 expref: 53 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.740850:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575606.740855:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575606.740903:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383d1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c8c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575606.741645:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789575606.741834:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.741850:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.741863:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.741937:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383d1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c8c expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.741955:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c8c expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.741979:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575606.741982:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575606.741986:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0400, rc 0) 00000100:00100000:3.0:1789575606.742075:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11517:x1876505676297216:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1312us (1639us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789575606.742998:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:1.0:1789575606.747813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.747914:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676297472 00000100:00100000:2.0:1789575606.747926:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676297472 00000100:00100000:2.0:1789575606.747984:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 175 00000100:00100000:2.0:1789575606.747993:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11517:x1876505676297472:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575606.748058:0:7184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575606.748100:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c8c expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748117:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575606.748128:0:7184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575606.748152:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748166:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748189:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748205:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748212:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748219:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748454:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748463:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748469:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748475:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575606.748479:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748486:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748494:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575606.748497:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575606.748501:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748513:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383d2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748522:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748527:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748532:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748537:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575606.748540:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748547:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748553:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x711bc78f (ffff8e9683773d00) 00010000:00010000:2.0:1789575606.748556:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575606.748559:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.748564:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383d36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x711bc78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575606.748636:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676297472:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 643us (833us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789575606.748645:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 175 00000100:00100000:1.0:1789575606.754143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.754226:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676297600 00000100:00100000:3.0:1789575606.754238:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676297600 00000100:00100000:3.0:1789575606.754303:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 176 00000100:00100000:3.0:1789575606.754315:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11517:x1876505676297600:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575606.754427:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575606.754454:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383d3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c93 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754494:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754508:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754520:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754620:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383d3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 55 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754637:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 54 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.754652:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:3.0:1789575606.754655:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789575606.754659:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f0e00, rc 0) 00000100:00100000:3.0:1789575606.754723:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11517:x1876505676297600:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 409us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.754730:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 176 00000100:00100000:0.0:1789575606.757912:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.757977:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676297856 00000100:00100000:3.0:1789575606.757987:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676297856 00000100:00100000:3.0:1789575606.758044:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 177 00000100:00100000:3.0:1789575606.758056:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+54:11517:x1876505676297856:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789575606.758159:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.758181:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.758201:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575606.758565:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789575606.758574:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418845202750ns, next at 419845200507ns, rc = 0 00000004:00010000:3.0:1789575606.758641:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d42423f3 reply state 00000000b4dea13c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.758648:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575606.758738:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11517:x1876505676297856:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 685us (838us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789575606.758757:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 177 00010000:00010000:2.0:1789575606.760048:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760064:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760073:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760080:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575606.760085:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760095:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760114:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:2.0:1789575606.760117:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789575606.760122:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.760130:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.761113:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.761177:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676297984 00000100:00100000:1.0:1789575606.761191:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676297984 00000100:00100000:1.0:1789575606.761257:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 178 00000100:00100000:1.0:1789575606.761281:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+55:11517:x1876505676297984:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789575606.761305:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575606.761325:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5c9a expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.761551:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.761566:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.761585:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:1.0:1789575606.761588:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575606.761591:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0a00, rc 0) 00000100:00100000:1.0:1789575606.761697:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11517:x1876505676297984:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 417us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.761706:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 178 00000100:00100000:1.0:1789575606.763610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.763671:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676298112 00000100:00100000:2.0:1789575606.763679:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676298112 00000100:00100000:2.0:1789575606.763728:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789575606.763738:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+6:2357:x1876505676298112:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789575606.764042:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676298112:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 305us (437us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789575606.764049:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789575606.765732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.765897:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676298368 00000100:00100000:3.0:1789575606.765908:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676298368 00000100:00100000:3.0:1789575606.766014:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:3.0:1789575606.766025:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11517:x1876505676298368:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789575606.766282:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+57:11517:x1876505676298368:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 259us (558us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789575606.766290:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789575606.769058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.770417:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676298624 00000100:00100000:3.0:1789575606.770431:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676298624 00000100:00100000:3.0:1789575606.770484:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 179 00000100:00100000:3.0:1789575606.770493:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+57:11517:x1876505676298624:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789575606.770615:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+57:11517:x1876505676298624:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 122us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.770622:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 179 00000100:00100000:2.0:1789575606.777248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.777321:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676298752 00000100:00100000:0.0:1789575606.777333:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676298752 00000100:00100000:0.0:1789575606.777423:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 180 00000100:00100000:0.0:1789575606.777433:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+57:11517:x1876505676298752:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575606.777455:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575606.777477:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383d59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ca1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777746:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777762:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777773:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575606.777815:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575606.777839:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777869:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383d59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca1 expref: 59 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777901:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca1 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.777912:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:0.0:1789575606.777916:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789575606.777921:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575606.778043:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11517:x1876505676298752:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 610us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.778064:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 180 00000100:00100000:0.0:1789575606.781988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.782064:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676298880 00000100:00100000:2.0:1789575606.782075:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676298880 00000100:00100000:2.0:1789575606.782131:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789575606.782141:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676298880:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575606.782158:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575606.782180:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ca8 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575606.782215:0:9232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaac1b6, blocks: 0x1 00010000:00010000:2.0:1789575606.782234:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1789575606.782239:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575606.782248:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 8 pid: 9232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.782265:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 8 pid: 9232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.782279:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575606.782341:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2356:x1876505676298880:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 201us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575606.782348:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789575606.788037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.788105:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299136 00000100:00100000:1.0:1789575606.788116:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299136 00000100:00100000:1.0:1789575606.788177:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:1.0:1789575606.788199:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11517:x1876505676299136:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789575606.788315:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11517:x1876505676299136:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 128us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.788322:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:0.0:1789575606.795119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.795244:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299264 00000100:00100000:2.0:1789575606.795259:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299264 00000100:00100000:2.0:1789575606.795389:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789575606.795401:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:11517:x1876505676299264:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575606.795586:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575606.795611:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5caf expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.795646:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.795655:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575606.795659:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575606.795666:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.795702:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.795714:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575606.795725:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6709:1876505699368704:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575606.795809:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1789575606.804616:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6709:1876505699368704:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575606.804659:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.804683:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:0.0:1789575606.804754:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:11517:x1876505676299264:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 9355us (9645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.804764:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:3.0:1789575606.807672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.807855:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299392 00000100:00100000:0.0:1789575606.807865:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299392 00010000:00010000:0.0:1789575606.807916:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.807957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789575606.807966:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676299392:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575606.807979:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575606.808001:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.808014:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.808050:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383d67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca8 expref: 9 pid: 9232 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.808064:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575606.808068:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575606.808075:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.808094:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.808127:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.808140:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1876505699368832:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789575606.808220:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789575606.819832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.819944:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299520 00000100:00100000:2.0:1789575606.819958:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299520 00002000:00100000:2.0:1789575606.820023:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e9586828000 x1876505676299520/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:627/0 lens 504/0 e 0 to 0 dl 1789575617 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789575606.820035:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9586828000 with x1876505676299520 ext(0->8) 00002000:00010000:2.0:1789575606.820042:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9586828000 00000100:00100000:2.0:1789575606.820101:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:2.0:1789575606.820111:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2358:x1876505676299520:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789575606.820646:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2358:x1876505676299520:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 535us (825us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789575606.820655:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789575606.820656:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1876505699368832:192.168.202.32@tcp:105: 00002000:00100000:2.0:1789575606.820662:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e9586828000 x1876505676299520/t4294967315(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:627/0 lens 504/448 e 0 to 0 dl 1789575617 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789575606.820670:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9586828000 with x1876505676299520 ext(0->8) 00002000:00010000:2.0:1789575606.820673:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9586828000 00010000:00010000:0.0:1789575606.820680:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575606.820704:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676299392:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 12739us (13049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.820713:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789575606.834909:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.834997:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299648 00000100:00100000:2.0:1789575606.835009:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299648 00000100:00100000:2.0:1789575606.835103:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:2.0:1789575606.835114:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11517:x1876505676299648:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789575606.857773:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11517:x1876505676299648:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 22648us (22863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.857799:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 182 00000001:00080000:0.0:1789575606.858006:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:0.0:1789575606.858026:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1789575606.858061:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1789575606.858086:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:0.0:1789575606.858105:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:0.0:1789575606.858125:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1789575606.858130:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789575606.858179:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e96bbbe56c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789575606.858185:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e9690a0fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bbbe5180 00000020:00080000:0.0:1789575606.858188:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e9690a0f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bbe4a800 00000020:00080000:3.0:1789575606.858242:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789575606.858458:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789575606.858787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699368960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789575606.858854:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575606.858987:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699368960 00000100:00100000:2.0:1789575606.858998:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699368960 00000100:00080000:1.0:1789575606.859043:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575606.859059:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575606.859071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699369088:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789575606.859073:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789575606.859088:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699368960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789575606.859113:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575606.859155:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699369088 00000100:00100000:1.0:1789575606.859159:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699369088 00000100:00100000:1.0:1789575606.859192:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789575606.859201:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699369088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789575606.859219:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789575606.859254:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaac1b4, atime: 0x6aaac1b4, ctime: 0x6aaac1b4, blocks: 0x1 00010000:00010000:1.0:1789575606.859264:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.859286:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1789575606.859291:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575606.859300:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.859321:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.859333:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.859343:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575606.859415:0:9232:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789575606.859419:0:9232:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789575606 00002000:00010000:2.0:1789575606.859422:0:9232:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789575606.859425:0:9232:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789575606 -> 1789575606 00002000:00010000:2.0:1789575606.859428:0:9232:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789575606.859470:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699368960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 385us (615us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789575606.859477:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1789575606.860472:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bbe94380/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789575606.860481:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699368960:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789575606.860749:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575606.860778:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575606.860787:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.860809:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575606.860814:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.860825:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.860849:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.860856:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919b5533/0xc45cc82a22383d75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.860887:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575606.860889:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575606.860891:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575606.861527:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699369088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2325us (2412us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789575606.861537:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789575606.861835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.861914:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676299776 00000100:00100000:1.0:1789575606.861922:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676299776 00000004:00080000:2.0:1789575606.861971:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bbd07100/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789575606.861979:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699369088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789575606.862006:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:1.0:1789575606.862017:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676299776:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789575606.901092:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1789575606.901112:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789575606.901155:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676299776:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 39135us (39315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.901166:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:3.0:1789575606.904228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.904307:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300032 00000100:00100000:0.0:1789575606.904316:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300032 00000100:00100000:0.0:1789575606.904405:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:0.0:1789575606.904416:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11517:x1876505676300032:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789575606.904473:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575606.904507:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ca1 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.904526:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:0.0:1789575606.904530:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575606.904562:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.904572:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.904579:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575606.904844:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6576435 reply state 00000000dbeb191f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.904852:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789575606.904972:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11517:x1876505676300032:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 557us (750us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789575606.904980:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 183 00010000:00010000:2.0:1789575606.907839:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907853:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907858:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907862:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575606.907866:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907880:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907895:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:2.0:1789575606.907897:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575606.907901:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.907905:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383d7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.908127:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.908179:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300160 00000100:00100000:2.0:1789575606.908190:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300160 00000100:00100000:2.0:1789575606.908248:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789575606.908266:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676300160:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789575606.908825:0:9232:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789575606.908829:0:9232:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789575606 -> 1789575605 00002000:00010000:2.0:1789575606.908831:0:9232:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789575604 00002000:00010000:2.0:1789575606.908832:0:9232:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789575606 -> 1789575605 00002000:00010000:2.0:1789575606.908834:0:9232:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789575606.908897:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676300160:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 632us (771us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789575606.908905:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:3.0:1789575606.914106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.914238:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300416 00000100:00100000:1.0:1789575606.914252:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300416 00000100:00100000:1.0:1789575606.914327:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:1.0:1789575606.914348:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11517:x1876505676300416:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789575606.914471:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.914491:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 18 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.914513:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.914552:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 18 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.914587:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 18 pid: 9231 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575606.914603:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699369216:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575606.914688:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575606.916986:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575606.917049:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300544 00000100:00100000:3.0:1789575606.917057:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300544 00010000:00010000:3.0:1789575606.917089:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 19 pid: 9231 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.917145:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789575606.917167:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+19:2357:x1876505676300544:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575606.917183:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575606.917190:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 19 pid: 9231 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.917215:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 19 pid: 9231 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.917237:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:3.0:1789575606.917242:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.917251:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.917259:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.917277:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575606.917331:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+19:2357:x1876505676300544:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 165us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.917345:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00010000:00010000:0.0:1789575606.917419:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c93 expref: 18 pid: 9231 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.917432:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686981180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699369216:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575606.917449:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917455:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917459:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917482:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917486:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917491:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917512:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575606.917516:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917522:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917528:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:0.0:1789575606.917530:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789575606.917532:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.917536:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.917567:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+17:11517:x1876505676300416:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 3233us (3475us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789575606.917572:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:3.0:1789575606.919859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.919969:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300672 00000100:00100000:0.0:1789575606.919981:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300672 00000100:00100000:0.0:1789575606.920101:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:0.0:1789575606.920113:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676300672:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789575606.920162:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.920187:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.920224:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789575606.920228:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575606.920233:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.920277:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.920292:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 8 pid: 6709 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.920307:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6709:1876505699369344:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575606.920435:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575606.922503:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6709:1876505699369344:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575606.922526:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.923072:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575606.923134:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676300800 00000100:00100000:2.0:1789575606.923143:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676300800 00010000:00010000:2.0:1789575606.923190:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575606.923233:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789575606.923241:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969df03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676300800:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575606.923256:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575606.923287:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.923299:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.923324:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1172db5/0xc45cc82a22383d6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5caf expref: 9 pid: 6709 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.923405:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575606.923409:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789575606.923413:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.923421:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.923444:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575606.923487:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969df03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676300800:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 246us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575606.923492:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00010000:00010000:3.0:1789575606.923631:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923638:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923667:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923673:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923679:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923686:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575606.923690:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923699:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923711:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575606.923719:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ad7aed/0xc45cc82a22383d8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.923905:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676300672:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 3795us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.923913:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:3.0:1789575606.925654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.925761:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301056 00000100:00100000:1.0:1789575606.925770:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301056 00000100:00100000:1.0:1789575606.925859:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:1.0:1789575606.925867:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+17:11517:x1876505676301056:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789575606.925968:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.925987:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.925996:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.926223:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.926231:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.926238:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.926287:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 18 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.926298:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 18 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575606.926310:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699369472:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575606.926533:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789575606.929789:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699369472:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575606.929828:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.930305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.930429:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301184 00000100:00100000:1.0:1789575606.930437:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301184 00010000:00010000:1.0:1789575606.930474:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 19 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575606.930509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:1.0:1789575606.930519:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:2357:x1876505676301184:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575606.930535:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575606.930542:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 19 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930555:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 19 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930601:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c9a expref: 19 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930621:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:1.0:1789575606.930626:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930638:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930646:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.930675:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575606.930730:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2357:x1876505676301184:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 212us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575606.930737:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00010000:00010000:2.0:1789575606.930807:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575606.930816:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575606.931086:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789575606.931256:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789575606.931303:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789575606.931487:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699369600:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789575606.931538:0:7184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575606.931572:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686507480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575606.931723:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699369600 00000100:00100000:3.0:1789575606.931729:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699369600 00000100:00100000:3.0:1789575606.931763:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789575606.931771:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699369600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789575606.931845:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699369600:12345-0@lo:1000:mdt00_003.0 Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575606.931853:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575606.931891:0:7184:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789575606.931898:0:7184:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bbe94380, transno 4294967316 00000100:00100000:2.0:1789575606.931919:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699369600:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789575606.932306:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789575606.932348:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699369728:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789575606.932406:0:7184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575606.932435:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60840 going to sleep for 11 seconds 00000100:00100000:3.0:1789575606.932532:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699369728 00000100:00100000:3.0:1789575606.932537:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699369728 00000100:00100000:3.0:1789575606.932570:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789575606.932576:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7184:x1876505699369728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789575606.932728:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7184:x1876505699369728:12345-0@lo:1000:mdt00_003.0 Request processed in 151us (321us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789575606.932735:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789575606.932785:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7184:1876505699369728:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789575606.932816:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932826:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932833:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932840:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.932845:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932860:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932888:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e9687bd8200) 00010000:00010000:1.0:1789575606.932891:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575606.932896:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932902:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383d98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932937:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932944:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932949:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932954:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575606.932957:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932964:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932972:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:1.0:1789575606.932974:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575606.932977:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.932994:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383ccd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.933033:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.933049:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 21 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.933057:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.933081:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 21 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.933095:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 21 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575606.933108:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699369856:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575606.933181:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1180 going to sleep for 11 seconds 00000100:00100000:1.0:1789575606.935523:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699369856:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575606.935558:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575606.937307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575606.941159:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301312 00000100:00100000:0.0:1789575606.941180:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301312 00010000:00010000:0.0:1789575606.941236:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 22 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.941292:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:0.0:1789575606.941304:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+22:2357:x1876505676301312:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575606.941334:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575606.941351:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 22 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941388:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 22 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941413:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5c7e expref: 22 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941429:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:0.0:1789575606.941435:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941447:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941457:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941490:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575606.941572:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+21:2357:x1876505676301312:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 269us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575606.941581:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00010000:00010000:0.0:1789575606.941743:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941750:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941770:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941775:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941780:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941784:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575606.941788:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941793:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941799:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:0.0:1789575606.941801:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575606.941804:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941808:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22383d9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941815:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941818:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941821:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941828:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575606.941830:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941834:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941838:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773c00) 00010000:00010000:0.0:1789575606.941839:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789575606.941841:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.941844:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383d91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575606.942112:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11517:x1876505676301056:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 16244us (16465us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789575606.942121:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 185 00000020:00080000:0.0:1789575606.942124:0:7184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789575606.942247:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789575606.942252:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789575606.942754:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789575606.942774:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789575606.946765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575606.946837:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301568 00000100:00100000:1.0:1789575606.946847:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301568 00000100:00100000:1.0:1789575606.946914:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:1.0:1789575606.946925:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11517:x1876505676301568:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789575606.947731:0:5866:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789575606.947854:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789575606.947922:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.947943:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.947958:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.947968:0:5866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.947975:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.947982:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575606.948003:0:5866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789575606.948119:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+22:11517:x1876505676301568:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 1193us (1359us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789575606.948129:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000020:00080000:1.0:1789575606.948136:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789575606.948284:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575606.948292:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.948300:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe86800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575606.948304:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.948321:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.948334:0:8472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e96831e1900) 00010000:00010000:0.0:1789575606.948338:0:8472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789575606.948344:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.948350:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a22383da6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575606.948409:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575606.948412:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575606.948414:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789575607.047519:0:12438:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575607.047533:0:12438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575607.047580:0:12438:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789575607.047588:0:12438:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789575607.111299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.111621:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301824 00000100:00100000:3.0:1789575607.111632:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301824 00000100:00100000:3.0:1789575607.111781:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:3.0:1789575607.111793:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+22:11527:x1876505676301824:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575607.111822:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575607.111842:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cb6 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.111946:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383db4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.111968:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383db4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.111980:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383db4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575607.111992:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789575607.112100:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cb6 expref: 25 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.112114:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383db4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cb6 expref: 24 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.112122:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575607.112125:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789575607.112129:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1000, rc 0) 00000100:00100000:3.0:1789575607.112185:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+24:11527:x1876505676301824:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 396us (898us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789575607.112201:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00080000:2.0:1789575607.112446:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575607.115106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.117076:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676301952 00000100:00100000:2.0:1789575607.117090:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676301952 00000100:00100000:2.0:1789575607.117157:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:2.0:1789575607.117167:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+24:11527:x1876505676301952:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789575607.117263:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117284:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117613:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117636:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117645:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117653:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117970:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117979:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.117987:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575607.118040:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118056:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118065:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118072:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118080:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.118085:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118094:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118108:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575607.118111:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.118117:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118130:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383dc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118144:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118150:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118156:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118162:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.118165:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118172:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118181:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9683773300) 00010000:00010000:2.0:1789575607.118184:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.118187:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118192:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383dc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118209:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118216:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118238:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118244:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.118247:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118254:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118270:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9683773700) 00010000:00010000:2.0:1789575607.118272:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.118275:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.118281:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383dd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.118410:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+24:11527:x1876505676301952:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1241us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.118421:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:1.0:1789575607.165290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575607.165541:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676302208 00000100:00100000:0.0:1789575607.165553:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676302208 00000100:00100000:0.0:1789575607.165621:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:0.0:1789575607.165633:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+24:11530:x1876505676302208:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575607.165658:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575607.165682:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cbd expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165789:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165810:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165851:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165913:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165922:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.165931:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167051:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167070:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167095:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575607.167110:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789575607.167395:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167404:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167412:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167418:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575607.167422:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167430:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167444:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575607.167447:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575607.167452:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167458:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383dde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167476:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.167482:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.169996:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170009:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575607.170016:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170027:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170056:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687dc9400) 00010000:00010000:1.0:1789575607.170060:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789575607.170066:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170074:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170198:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 27 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170219:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 26 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.170227:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:1.0:1789575607.170229:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575607.170232:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87a00, rc 0) 00000100:00100000:1.0:1789575607.170793:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11530:x1876505676302208:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 5155us (5507us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789575607.170835:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:0.0:1789575607.176454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.176581:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676302336 00000100:00100000:3.0:1789575607.176592:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676302336 00000100:00100000:3.0:1789575607.176652:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:3.0:1789575607.176662:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11530:x1876505676302336:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789575607.176731:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176748:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176779:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176807:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176815:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176821:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176832:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.176836:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176844:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176855:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:3.0:1789575607.176858:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575607.176863:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.176879:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383dfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.176967:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11530:x1876505676302336:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 306us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.176975:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:0.0:1789575607.188186:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575607.189411:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676302592 00000100:00100000:1.0:1789575607.189494:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676302592 00000100:00100000:0.0:1789575607.191571:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789575607.191599:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11530:x1876505676302592:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789575607.191900:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+27:11530:x1876505676302592:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 312us (3724us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789575607.191909:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:1.0:1789575607.229865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.230057:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676302848 00000100:00100000:2.0:1789575607.230070:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676302848 00000100:00100000:2.0:1789575607.230147:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:2.0:1789575607.230159:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+27:11064:x1876505676302848:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575607.230193:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575607.230216:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383e01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cc4 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.230345:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.230360:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 28 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.230401:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.230437:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 28 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.230451:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 28 pid: 7184 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.230465:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699369984:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575607.230567:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60780 going to sleep for 11 seconds 00000100:00100000:2.0:1789575607.235825:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe97800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699369984:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575607.235880:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575607.236234:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.236734:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676302976 00000100:00100000:3.0:1789575607.236879:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676302976 00010000:00010000:3.0:1789575607.236929:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 29 pid: 7184 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.236980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:3.0:1789575607.236992:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+29:2358:x1876505676302976:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575607.237012:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575607.237021:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 29 pid: 7184 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237036:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 29 pid: 7184 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237061:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cbd expref: 29 pid: 7184 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237077:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:3.0:1789575607.237082:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237092:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237100:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.237143:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575607.237273:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+28:2358:x1876505676302976:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 282us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.237290:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00010000:00010000:2.0:1789575607.237636:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.237655:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575607.237676:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789575607.237891:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22383e01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 29 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.237910:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 28 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.237917:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:2.0:1789575607.237920:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789575607.237923:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9600, rc 0) 00000100:00100000:2.0:1789575607.237955:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11064:x1876505676302848:12345-192.168.202.32@tcp:101:bash.0 Request processed in 7799us (8105us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789575607.237963:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:1.0:1789575607.244673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.244779:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676303232 00000100:00100000:2.0:1789575607.244791:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676303232 00000100:00100000:2.0:1789575607.244879:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:2.0:1789575607.244891:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11064:x1876505676303232:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:2.0:1789575607.245687:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.245708:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.245722:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575607.245857:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789575607.245901:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b55871a reply state 00000000c7b22d73 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.245913:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789575607.245995:0:7184:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789575607.246595:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11064:x1876505676303232:12345-192.168.202.32@tcp:36:bash.0 Request processed in 1703us (1934us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789575607.246604:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000020:00080000:2.0:1789575607.246610:0:7184:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789575607.252900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.253421:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676303360 00000100:00100000:3.0:1789575607.253443:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676303360 00000100:00100000:3.0:1789575607.253504:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:3.0:1789575607.253515:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11064:x1876505676303360:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575607.253545:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575607.253570:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383e1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ccb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.253631:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383e1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ccb expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.253648:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383e1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ccb expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.253668:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:3.0:1789575607.253671:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575607.253674:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e95850f1a00, rc 0) 00000100:00100000:3.0:1789575607.253741:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+33:11064:x1876505676303360:12345-192.168.202.32@tcp:101:bash.0 Request processed in 226us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.253748:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 192 00010000:00010000:2.0:1789575607.262395:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262421:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262438:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262444:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.262450:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262459:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262478:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:2.0:1789575607.262481:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.262486:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.262493:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575607.265916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.266012:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676303488 00000100:00100000:2.0:1789575607.266023:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676303488 00000100:00100000:2.0:1789575607.266086:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:2.0:1789575607.266096:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:11064:x1876505676303488:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575607.266140:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575607.266169:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cd2 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575607.266212:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaac1b5, atime: 0x6aaac1b4, ctime: 0x6aaac1b5, blocks: 0xb 00010000:00010000:2.0:1789575607.266239:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:2.0:1789575607.266245:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575607.266254:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.266270:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.266282:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575607.266343:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:11064:x1876505676303488:12345-192.168.202.32@tcp:101:bash.0 Request processed in 249us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.266351:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00010000:00010000:2.0:1789575607.272736:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575607.275130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.275306:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676303616 00000100:00100000:3.0:1789575607.275318:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676303616 00002000:00010000:3.0:1789575607.275576:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789575607.275583:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9686982d80 with x1876505676303616 ext(0->18446744073709551615) 00002000:00010000:3.0:1789575607.275596:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9686982d80. 00000100:00100000:3.0:1789575607.275727:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575607.275749:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676303616:12345-192.168.202.32@tcp:10:bash.0 00002000:00010000:3.0:1789575607.276083:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789575607.276087:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789575605 -> 1789575607 00002000:00010000:3.0:1789575607.276090:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789575604 -> 1789575604 00002000:00010000:3.0:1789575607.276092:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789575605 -> 1789575607 00002000:00010000:3.0:1789575607.276095:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789575607.276172:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676303616:12345-192.168.202.32@tcp:10:bash.0 Request processed in 434us (1051us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789575607.276180:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00002000:00010000:3.0:1789575607.276193:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789575607.276197:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9686982d80 with x1876505676303616 ext(0->18446744073709551615) 00002000:00010000:3.0:1789575607.276203:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9686982d80. 00000100:00100000:0.0:1789575607.375570:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.375734:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676303744 00000100:00100000:2.0:1789575607.375747:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676303744 00000100:00100000:2.0:1789575607.375814:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:2.0:1789575607.375826:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11544:x1876505676303744:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789575607.375950:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.375968:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.375999:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376015:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376022:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376029:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376312:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376322:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376329:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575607.376415:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376636:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376645:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376653:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376670:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.376675:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376689:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376703:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575607.376705:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.376711:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376717:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376730:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376736:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376742:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376747:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.376750:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376756:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376775:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9683773200) 00010000:00010000:2.0:1789575607.376778:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.376782:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376787:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376802:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376809:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376814:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376819:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.376821:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376827:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376835:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:2.0:1789575607.376838:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.376841:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.376847:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.377041:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11544:x1876505676303744:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1214us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.377051:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:1.0:1789575607.453122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.453308:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676304000 00000100:00100000:2.0:1789575607.453320:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676304000 00000100:00100000:2.0:1789575607.453458:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:2.0:1789575607.453470:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+32:11547:x1876505676304000:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575607.453492:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575607.453515:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cd9 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453618:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453633:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453644:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453658:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453665:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453671:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453977:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3e00/0xc45cc82a22383e55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453987:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3e00/0xc45cc82a22383e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.453993:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3e00/0xc45cc82a22383e55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575607.454003:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789575607.454111:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454119:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454126:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454132:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.454137:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454145:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454158:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575607.454161:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.454167:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454183:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22383e47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454212:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454218:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454224:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454229:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.454232:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454238:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454245:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9683773200) 00010000:00010000:2.0:1789575607.454248:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.454251:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454256:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a22383e4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454302:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9400/0xc45cc82a22383e40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd9 expref: 35 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454318:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3e00/0xc45cc82a22383e55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd9 expref: 34 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.454332:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:2.0:1789575607.454334:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789575607.454337:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3e00, rc 0) 00000100:00100000:2.0:1789575607.454460:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+34:11547:x1876505676304000:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 992us (1349us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789575607.454467:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:1.0:1789575607.469943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575607.470105:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676304128 00000100:00100000:0.0:1789575607.470119:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676304128 00000100:00100000:0.0:1789575607.470245:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:0.0:1789575607.470256:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+34:11547:x1876505676304128:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789575607.470329:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.470419:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 34 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.470682:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.470728:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 34 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.470744:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 34 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575607.470760:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699370112:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575607.470856:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575607.474294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.474565:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676304384 00000100:00100000:3.0:1789575607.474576:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676304384 00000100:00100000:3.0:1789575607.474645:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:3.0:1789575607.474655:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+35:5599:x1876505676304384:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789575607.475197:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+36:5599:x1876505676304384:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 531us (901us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789575607.475206:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789575607.475667:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699370112:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575607.475688:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575607.478296:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575607.478519:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676304512 00000100:00100000:0.0:1789575607.478530:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676304512 00010000:00010000:0.0:1789575607.478575:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 36 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575607.478655:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:0.0:1789575607.478666:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+36:2357:x1876505676304512:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575607.478682:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575607.478703:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 36 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478716:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 36 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478738:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22383e08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cc4 expref: 36 pid: 5864 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478754:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:0.0:1789575607.478759:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478769:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478777:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575607.478811:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575607.478877:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+35:2357:x1876505676304512:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 214us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575607.478884:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00010000:00010000:2.0:1789575607.479801:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479814:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479846:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479853:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479860:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479874:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.479879:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479886:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479899:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:2.0:1789575607.479914:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575607.479918:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.479924:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.479992:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+34:11547:x1876505676304128:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 9737us (10068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.480000:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:1.0:1789575607.483241:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.483323:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676304768 00000100:00100000:2.0:1789575607.483334:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676304768 00000100:00100000:2.0:1789575607.483418:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789575607.483438:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+34:11547:x1876505676304768:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789575607.483649:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11547:x1876505676304768:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 214us (418us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789575607.483654:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:1.0:1789575607.639294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.639402:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676305024 00000100:00100000:3.0:1789575607.639418:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676305024 00000100:00100000:3.0:1789575607.639534:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:3.0:1789575607.639546:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+35:11558:x1876505676305024:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:3.0:1789575607.639574:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575607.639622:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ce0 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639719:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639735:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639748:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639765:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639772:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.639778:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640196:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640207:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640215:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575607.640225:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789575607.640315:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640333:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640340:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640347:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.640351:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640359:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640399:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575607.640403:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575607.640409:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640416:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0200/0xc45cc82a22383e71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640431:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640437:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640443:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640448:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.640457:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640464:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640472:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8b00) 00010000:00010000:3.0:1789575607.640475:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575607.640478:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640484:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0400/0xc45cc82a22383e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640531:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0e00/0xc45cc82a22383e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce0 expref: 38 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640546:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce0 expref: 37 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.640554:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:3.0:1789575607.640556:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575607.640560:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:3.0:1789575607.640795:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+37:11558:x1876505676305024:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1250us (1510us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789575607.640803:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:1.0:1789575607.655464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.655554:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676305280 00000100:00100000:2.0:1789575607.655569:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676305280 00000100:00100000:2.0:1789575607.655667:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789575607.655681:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+37:11558:x1876505676305280:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:2.0:1789575607.656075:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11558:x1876505676305280:12345-192.168.202.32@tcp:35:cat.0 Request processed in 398us (622us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789575607.656088:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:1.0:1789575607.693560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.693998:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676305536 00000100:00100000:3.0:1789575607.694015:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676305536 00000100:00100000:3.0:1789575607.694097:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 197 00000100:00100000:3.0:1789575607.694110:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11559:x1876505676305536:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:3.0:1789575607.694615:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789575607.694660:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce0 expref: 38 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694706:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3e00/0xc45cc82a22383e55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd9 expref: 37 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694723:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1a00/0xc45cc82a22383e1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ccb expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694735:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e96831e1f00) 00010000:00010000:3.0:1789575607.694750:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575607.694779:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694799:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694813:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694830:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694838:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.694845:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695220:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695228:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695235:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575607.695875:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1789575607.695964:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695977:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695987:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.695996:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696005:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696012:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696046:0:5863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575607.696068:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696086:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696094:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696100:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.696105:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696115:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696126:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575607.696130:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789575607.696135:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696141:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383e9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696162:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696167:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696173:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696178:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.696187:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696194:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696202:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575607.696204:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575607.696207:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.696213:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383e8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575607.696222:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000763a6c29 reply state 000000006c8e15c9 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.696232:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789575607.696324:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+37:11559:x1876505676305536:12345-192.168.202.32@tcp:36:rm.0 Request processed in 2213us (2771us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789575607.696333:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 197 00010000:00010000:1.0:1789575607.697102:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575607.697112:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.697121:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575607.697125:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.697132:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.697144:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:1.0:1789575607.697146:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789575607.697161:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.697167:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575607.697200:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575607.697202:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575607.697204:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575607.698623:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698635:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698650:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698654:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.698658:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698663:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698723:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8b00) 00010000:00010000:2.0:1789575607.698727:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.698732:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.698739:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383e94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575607.721100:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699370240:0@lo:400:kworker.0 00000100:00100000:3.0:1789575607.721154:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699370496:0@lo:400:kworker.0 00000100:00100000:0.0:1789575607.721154:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699370624:0@lo:400:kworker.0 00000100:00100000:2.0:1789575607.721222:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699370368:0@lo:400:kworker.0 00000100:00100000:1.0:1789575607.721258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575607.721319:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575607.721534:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699370240 00000100:00100000:3.0:1789575607.721542:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699370240 00000100:00100000:3.0:1789575607.721904:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789575607.721918:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699370240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575607.721976:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699370240:12345-0@lo:400:kworker.0 Request processed in 62us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.721982:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789575607.722058:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699370496 00000100:00100000:3.0:1789575607.722063:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699370496 00000100:00100000:3.0:1789575607.722101:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789575607.722107:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699370496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575607.723786:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699370496:12345-0@lo:400:kworker.0 Request processed in 1653us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.723801:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789575607.723939:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699370496:0@lo:400:kworker.0 00000100:00080000:3.0:1789575607.724030:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575607.724840:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575607.725084:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575607.725129:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575607.725144:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699370752:0@lo:400:kworker.0 00000100:00100000:2.0:1789575607.725186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575607.725225:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699370368 00000100:00100000:2.0:1789575607.725232:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699370368 00000100:00100000:2.0:1789575607.725270:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699370752 00000100:00100000:2.0:1789575607.725273:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699370752 00000100:00100000:2.0:1789575607.725307:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789575607.725317:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699370368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575607.725410:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699370368:12345-0@lo:400:kworker.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.725418:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789575607.725434:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789575607.725441:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699370752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575607.725470:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699370752:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.725475:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789575607.725510:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699370752:0@lo:400:kworker.0 00000100:00100000:2.0:1789575607.725521:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699370368:0@lo:400:kworker.0 00000100:00100000:1.0:1789575607.725623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699370240:0@lo:400:kworker.0 00000100:00080000:1.0:1789575607.727498:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575607.728614:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699370624 00000100:00100000:3.0:1789575607.728631:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699370624 00000100:00100000:3.0:1789575607.728720:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789575607.728732:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1876505699370624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575607.728920:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1876505699370624:12345-0@lo:400:kworker.0 Request processed in 189us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.728949:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789575607.728970:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699370624:0@lo:400:kworker.0 00000100:00100000:1.0:1789575607.830600:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.830746:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676305792 00000100:00100000:3.0:1789575607.830757:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676305792 00000100:00100000:3.0:1789575607.830825:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:3.0:1789575607.830836:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+36:11565:x1876505676305792:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575607.830894:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575607.830919:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ea9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ce7 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831076:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831093:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831132:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831153:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831161:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.831168:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575607.831827:0:7184:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789575607.832012:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832023:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832032:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832068:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832076:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832083:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832090:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575607.832101:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832109:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832122:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575607.832125:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575607.832131:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832137:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383eb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575607.832153:0:7184:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089c6fd10 reply state 00000000ed630363 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.832162:0:7184:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789575607.832194:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383ea9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 39 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832209:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 38 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.832216:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:3.0:1789575607.832219:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575607.832221:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:3.0:1789575607.832308:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+39:11565:x1876505676305792:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1473us (1721us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789575607.832316:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:1.0:1789575607.839590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:2.0:1789575607.839690:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839712:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839721:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839727:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575607.839733:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839740:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839756:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8d00) 00010000:00010000:2.0:1789575607.839760:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575607.839782:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.839788:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383eb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.842728:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676305920 00000100:00100000:3.0:1789575607.842743:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676305920 00000100:00100000:3.0:1789575607.842812:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789575607.842822:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2356:x1876505676305920:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575607.842843:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575607.842874:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cee expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575607.842907:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575607.842930:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789575607.842935:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575607.842945:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.842965:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.842979:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1600, rc 0) 00000100:00100000:3.0:1789575607.843049:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2356:x1876505676305920:12345-192.168.202.32@tcp:101:bash.0 Request processed in 229us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575607.843207:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:0.0:1789575607.849658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.849821:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306048 00000100:00100000:2.0:1789575607.849832:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306048 00000100:00100000:2.0:1789575607.849904:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:2.0:1789575607.849914:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:11565:x1876505676306048:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575607.849933:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575607.849951:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cf5 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.849984:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.849993:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575607.849997:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575607.850003:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.850041:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.850056:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575607.850088:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699370880:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575607.850211:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e54480 going to sleep for 11 seconds 00000100:00100000:2.0:1789575607.859690:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6709:1876505699370880:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575607.859760:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575607.859788:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3c00, rc 0) 00000100:00100000:2.0:1789575607.859898:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:11565:x1876505676306048:12345-192.168.202.32@tcp:101:bash.0 Request processed in 9982us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.859913:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:1.0:1789575607.862004:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.862402:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306176 00000100:00100000:3.0:1789575607.862414:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306176 00010000:00010000:3.0:1789575607.862464:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.862572:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:3.0:1789575607.862596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2358:x1876505676306176:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575607.862614:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575607.862641:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.862658:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.862696:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383ecc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cee expref: 9 pid: 6706 timeout: 519 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.862729:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575607.862734:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575607.862745:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.862757:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575607.862804:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575607.862820:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1876505699371008:192.168.202.32@tcp:105: 00000100:00100000:3.0:1789575607.862934:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789575607.873354:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1876505699371008:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789575607.873412:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575607.873490:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676306176:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 10894us (11500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.873501:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:1.0:1789575607.878690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575607.878792:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306432 00000100:00100000:3.0:1789575607.878812:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306432 00000100:00100000:3.0:1789575607.878918:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:3.0:1789575607.878931:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+38:11565:x1876505676306432:12345-192.168.202.32@tcp:35:bash.0 00000001:00080000:3.0:1789575607.879298:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:3.0:1789575607.879750:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+40:11565:x1876505676306432:12345-192.168.202.32@tcp:35:bash.0 Request processed in 819us (1069us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789575607.879759:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000020:00080000:3.0:1789575607.879764:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789575607.949286:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575607.949340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575607.949468:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306688 00000100:00100000:2.0:1789575607.949479:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306688 00000100:00100000:2.0:1789575607.949553:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:2.0:1789575607.949561:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676306688:12345-192.168.202.32@tcp:16:kworker.0 00000100:00100000:2.0:1789575607.949702:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676306688:12345-192.168.202.32@tcp:16:kworker.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575607.949707:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:3.0:1789575607.950136:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306560 00000100:00100000:3.0:1789575607.950142:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306560 00002000:00100000:3.0:1789575607.950177:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e96bbd52a00 x1876505676306560/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:628/0 lens 504/0 e 0 to 0 dl 1789575618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575607.950189:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbd52a00 with x1876505676306560 ext(0->8) 00002000:00010000:3.0:1789575607.950195:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e96bbd52a00 00000100:00100000:3.0:1789575607.950223:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575607.950231:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676306560:12345-192.168.202.32@tcp:4:bash.0 00000100:00100000:0.0:1789575607.951674:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676306560:12345-192.168.202.32@tcp:4:bash.0 Request processed in 1432us (2387us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789575607.951686:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00002000:00100000:0.0:1789575607.951704:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e96bbd52a00 x1876505676306560/t4294967308(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:628/0 lens 504/448 e 0 to 0 dl 1789575618 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789575607.951712:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbd52a00 with x1876505676306560 ext(0->8) 00002000:00010000:0.0:1789575607.951717:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e96bbd52a00 00000100:00100000:1.0:1789575608.072036:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.072096:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676306816 00000100:00100000:2.0:1789575608.072122:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676306816 00000100:00100000:2.0:1789575608.072183:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 199 00000100:00100000:2.0:1789575608.072194:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+40:11581:x1876505676306816:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575608.072221:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575608.072256:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5cfc expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072329:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072344:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072358:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575608.072435:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789575608.072438:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575608.072455:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072474:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cfc expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072488:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cfc expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.072494:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575608.072496:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575608.072499:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2000, rc 0) 00000100:00100000:2.0:1789575608.072556:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+41:11581:x1876505676306816:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 363us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575608.072564:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 199 00000100:00100000:1.0:1789575608.080556:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.083317:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307072 00000100:00100000:0.0:1789575608.083334:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307072 00000100:00100000:0.0:1789575608.083443:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:0.0:1789575608.083456:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+41:11581:x1876505676307072:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575608.083478:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575608.083500:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383ee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d03 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.083613:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383eef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.083631:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.083643:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575608.083656:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789575608.083787:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383ee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d03 expref: 44 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.083811:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d03 expref: 43 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.083819:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:0.0:1789575608.083835:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575608.083839:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575608.083926:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+43:11581:x1876505676307072:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 472us (3380us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789575608.083934:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:1.0:1789575608.091246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.091341:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307328 00000100:00100000:2.0:1789575608.091350:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307328 00000100:00100000:2.0:1789575608.091421:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 201 00000100:00100000:2.0:1789575608.091429:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+43:11581:x1876505676307328:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575608.091451:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575608.091468:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383efd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d0a expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.091554:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.091569:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.091581:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575608.091593:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789575608.091739:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383efd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d0a expref: 46 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.091752:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d0a expref: 45 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.091759:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:2.0:1789575608.091761:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789575608.091775:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2600, rc 0) 00000100:00100000:2.0:1789575608.091827:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+45:11581:x1876505676307328:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 399us (591us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789575608.091832:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 201 00000100:00100000:1.0:1789575608.098162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.098231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307456 00000100:00100000:3.0:1789575608.098244:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307456 00000100:00100000:3.0:1789575608.098319:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575608.098331:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+45:2357:x1876505676307456:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575608.098347:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575608.098400:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383eef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d03 expref: 45 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.098423:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:3.0:1789575608.098429:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575608.098495:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+44:2357:x1876505676307456:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 166us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.098502:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:1.0:1789575608.110811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.110867:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307584 00000100:00100000:3.0:1789575608.110878:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307584 00000100:00080000:1.0:1789575608.110924:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575608.110945:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789575608.110957:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676307584:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:3.0:1789575608.111006:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.111024:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.111031:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789575608.111035:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575608.111038:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.111075:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.111090:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 10 pid: 6709 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.111104:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6708:1876505699371136:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575608.111208:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575608.115802:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6708:1876505699371136:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575608.115837:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:3.0:1789575608.115872:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.115934:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307712 00000100:00100000:0.0:1789575608.115948:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307712 00010000:00010000:0.0:1789575608.116115:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 11 pid: 6709 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.116163:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:0.0:1789575608.116173:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969df02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2358:x1876505676307712:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575608.116191:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789575608.116214:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789575608.116218:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789575608 00002000:00010000:0.0:1789575608.116220:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789575608 00010000:00010000:0.0:1789575608.116228:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 11 pid: 6709 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.116243:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 11 pid: 6709 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.116276:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22383ed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cf5 expref: 11 pid: 6709 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.116297:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575608.116303:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575608.116318:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.116329:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.116360:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575608.116408:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116417:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116438:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116444:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116449:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116453:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575608.116457:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116462:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116471:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.116481:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e66caf6/0xc45cc82a22383f12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.116548:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2357:x1876505676307584:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 5594us (5746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.116557:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:0.0:1789575608.116561:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969df02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676307712:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 386us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.116572:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:1.0:1789575608.122497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.123278:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676307968 00000100:00100000:2.0:1789575608.123291:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676307968 00000100:00100000:2.0:1789575608.123354:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:2.0:1789575608.123366:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+44:11581:x1876505676307968:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:2.0:1789575608.123467:0:5866:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d0a expref: 44 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575608.123902:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789575608.123944:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789575608.125174:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789575608.125245:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.125266:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 48 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.125275:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.125323:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 48 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.125341:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 48 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575608.125395:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5866:1876505699371264:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575608.125678:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60780 going to sleep for 11 seconds 00000100:00100000:1.0:1789575608.132655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.132802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308096 00000100:00100000:3.0:1789575608.132815:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308096 00010000:00010000:3.0:1789575608.132884:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 49 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.132937:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:3.0:1789575608.132947:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:2357:x1876505676308096:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575608.132969:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575608.132976:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 49 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.132991:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 49 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.133016:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:3.0:1789575608.133022:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.133034:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.133064:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.133085:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575608.133160:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+49:2357:x1876505676308096:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.133168:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00010000:00010000:2.0:1789575608.134699:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383ebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ce7 expref: 48 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575608.134725:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5866:1876505699371264:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575608.134751:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.134761:0:5866:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.134767:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575608.135029:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789575608.135271:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789575608.135700:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699371392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789575608.135781:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575608.135825:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575608.136802:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699371392 00000100:00100000:1.0:1789575608.136815:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699371392 00000100:00100000:1.0:1789575608.136919:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789575608.136932:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5866:x1876505699371392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789575608.137217:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5866:x1876505699371392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 287us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575608.137226:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789575608.137359:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575608.137902:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbe97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699371392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789575608.140337:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789575608.140486:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699371520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789575608.140578:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575608.140621:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789575608.140718:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699371520 00000100:00100000:1.0:1789575608.140727:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699371520 00000100:00100000:1.0:1789575608.140785:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789575608.140796:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5866:x1876505699371520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789575608.141027:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5866:x1876505699371520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 231us (448us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789575608.141035:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789575608.141269:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5866:1876505699371520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789575608.141336:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789575608.141542:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141553:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141561:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141567:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.141572:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141595:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141614:0:5866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:0.0:1789575608.141618:0:5866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789575608.141624:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.141629:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2a00/0xc45cc82a22383f19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789575608.141966:0:5866:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789575608.142183:0:5866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789575608.142200:0:5866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420228828696ns, next at 421228825426ns, rc = 0 00000001:00080000:0.0:1789575608.142207:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789575608.142318:0:5866:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9687bd8600) 00010000:00010000:0.0:1789575608.142322:0:5866:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789575608.142330:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22383f04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d0a expref: 52 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.142491:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11581:x1876505676307968:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 19126us (20001us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789575608.142503:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000020:00080000:0.0:1789575608.142510:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789575608.144939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.145052:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308224 00000100:00100000:2.0:1789575608.145062:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308224 00000100:00100000:2.0:1789575608.145127:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:2.0:1789575608.145138:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+51:11581:x1876505676308224:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575608.145168:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575608.145208:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a22383f20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d11 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.145302:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a22383f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d11 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.145318:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a22383f20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d11 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.145508:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575608.145511:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789575608.145516:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2400, rc 0) 00000100:00100000:2.0:1789575608.145570:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11581:x1876505676308224:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 435us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575608.145576:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:1.0:1789575608.151233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.151290:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308480 00000100:00100000:3.0:1789575608.151304:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308480 00000100:00100000:3.0:1789575608.151393:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:3.0:1789575608.151405:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+52:11581:x1876505676308480:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575608.151937:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11581:x1876505676308480:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 533us (714us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789575608.151947:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:1.0:1789575608.242215:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.242280:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308608 00000100:00100000:0.0:1789575608.242292:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308608 00000100:00100000:0.0:1789575608.242361:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:0.0:1789575608.242399:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11591:x1876505676308608:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:0.0:1789575608.242520:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242543:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242558:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242578:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242586:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242593:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242704:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242713:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242735:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789575608.242788:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242803:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242821:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242829:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242836:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.242841:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242851:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242874:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575608.242878:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.242885:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242891:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383f27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242909:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242914:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242920:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242925:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.242935:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242942:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242951:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575608.242953:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.242957:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242963:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242980:0:9231:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242986:0:9231:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242992:0:9231:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.242998:0:9231:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.243001:0:9231:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.243007:0:9231:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.243014:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.243016:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.243025:0:9231:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.243032:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.243116:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11591:x1876505676308608:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 745us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.243125:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:2.0:1789575608.244321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699371648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575608.244410:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575608.244528:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699371648 00000004:00080000:3.0:1789575608.244530:0:7870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420331157273ns, next at 421331154173ns, rc = 0 00000100:00100000:0.0:1789575608.244537:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699371648 00000100:00080000:3.0:1789575608.244576:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789575608.244595:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789575608.244605:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699371648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575608.244641:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575608.244697:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699371648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.244704:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789575608.246358:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699371648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789575608.298132:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789575608.303000:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789575608.303024:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789575608.334504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.334669:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308864 00000100:00100000:3.0:1789575608.334682:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308864 00000100:00100000:3.0:1789575608.334836:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:3.0:1789575608.334849:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+53:11594:x1876505676308864:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575608.334887:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575608.334916:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d18 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335010:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335048:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335064:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335084:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335092:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335099:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335252:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335262:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.335269:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575608.335283:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789575608.335974:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.335988:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.335996:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336003:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.336008:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336032:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336049:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575608.336053:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.336059:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336065:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22383f43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336085:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336092:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336099:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336105:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.336107:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336113:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336121:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8c00) 00010000:00010000:0.0:1789575608.336124:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.336127:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336141:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22383f4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336254:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a22383f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336273:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.336281:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.336283:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575608.336286:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:0.0:1789575608.336522:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+55:11594:x1876505676308864:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1674us (2025us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789575608.336533:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:1.0:1789575608.342326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.342676:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676308992 00000100:00100000:3.0:1789575608.342690:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676308992 00000100:00100000:3.0:1789575608.342797:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 205 00000100:00100000:3.0:1789575608.342810:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+55:11594:x1876505676308992:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789575608.342921:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.342961:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.342978:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343015:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343022:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343030:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343036:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575608.343041:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343050:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343064:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575608.343067:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789575608.343074:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.343081:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.343213:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+55:11594:x1876505676308992:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 405us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.343227:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 205 00000100:00100000:1.0:1789575608.345554:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.345689:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676309248 00000100:00100000:0.0:1789575608.345702:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676309248 00000100:00100000:0.0:1789575608.345774:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:0.0:1789575608.345786:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+55:11594:x1876505676309248:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789575608.346081:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11594:x1876505676309248:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 299us (540us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789575608.346088:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:0.0:1789575608.398045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575608.398277:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676309504 00000100:00100000:1.0:1789575608.398288:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676309504 00000100:00100000:1.0:1789575608.398470:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:1.0:1789575608.398482:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11604:x1876505676309504:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789575608.398509:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575608.398512:0:5864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789575608.398550:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2000/0xc45cc82a22383ee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cfc expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398571:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:1.0:1789575608.398576:0:5864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575608.398590:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383f66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d1f expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398694:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398709:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398717:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398751:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.398766:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 56 pid: 5863 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575608.398781:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e95876a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699371776:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575608.398885:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96862d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1789575608.403795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.403885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676309632 00000100:00100000:3.0:1789575608.403897:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676309632 00010000:00010000:3.0:1789575608.403945:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 57 pid: 5863 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.403991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:3.0:1789575608.404001:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+57:2357:x1876505676309632:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575608.404018:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575608.404037:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 57 pid: 5863 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.404051:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 57 pid: 5863 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.404086:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575608.404093:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.404103:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.404111:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.404130:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575608.404441:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+57:2357:x1876505676309632:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 440us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.404464:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00010000:00010000:2.0:1789575608.406418:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d18 expref: 56 pid: 5863 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575608.406446:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e95876a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5864:1876505699371776:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575608.406469:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.406480:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.406505:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575608.406530:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789575608.406689:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87a00/0xc45cc82a22383f66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 57 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.406705:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 56 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.406714:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575608.406717:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789575608.406720:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86e00, rc 0) 00000100:00100000:2.0:1789575608.406769:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11604:x1876505676309504:12345-192.168.202.32@tcp:101:bash.0 Request processed in 8290us (8736us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1789575608.406777:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:1.0:1789575608.411652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.411758:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676309888 00000100:00100000:0.0:1789575608.411769:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676309888 00000100:00100000:0.0:1789575608.411879:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 207 00000100:00100000:0.0:1789575608.411911:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+56:11604:x1876505676309888:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:0.0:1789575608.412672:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.412694:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.412708:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575608.412776:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1789575608.413060:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001903e1a7 reply state 00000000e151186c transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.413071:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789575608.413705:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+59:11604:x1876505676309888:12345-192.168.202.32@tcp:36:bash.0 Request processed in 1793us (2063us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789575608.413714:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 207 00000020:00080000:0.0:1789575608.413720:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789575608.417077:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417103:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417110:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417114:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575608.417118:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417146:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417162:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575608.417165:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575608.417170:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.417185:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383f7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575608.418170:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.418619:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310016 00000100:00100000:3.0:1789575608.418632:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310016 00000100:00100000:3.0:1789575608.418698:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 208 00000100:00100000:3.0:1789575608.418709:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11604:x1876505676310016:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789575608.418738:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575608.418759:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d26 expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.418893:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.418909:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 59 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.418919:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.418959:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 59 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.418973:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 59 pid: 5864 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.418987:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699371904:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575608.419083:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575608.422328:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699371904:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575608.422427:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575608.424641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.425099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310144 00000100:00100000:3.0:1789575608.425112:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310144 00010000:00010000:3.0:1789575608.425157:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 60 pid: 5864 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.425209:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:3.0:1789575608.425220:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+60:2358:x1876505676310144:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575608.425235:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575608.425242:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 60 pid: 5864 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425256:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 60 pid: 5864 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425280:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86e00/0xc45cc82a22383f6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d1f expref: 60 pid: 5864 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425299:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575608.425305:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425315:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425324:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.425622:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575608.425696:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+59:2358:x1876505676310144:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 476us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575608.425705:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00010000:00010000:0.0:1789575608.425827:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.425836:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575608.425897:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789575608.425902:0:7184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575608.425935:0:7184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.425974:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383f82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 59 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.426002:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 58 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.426010:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.426014:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575608.426016:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:0.0:1789575608.426047:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11604:x1876505676310016:12345-192.168.202.32@tcp:101:bash.0 Request processed in 7340us (7887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.426055:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 208 00000100:00100000:1.0:1789575608.430100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.431023:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310400 00000100:00100000:3.0:1789575608.431035:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310400 00000100:00100000:0.0:1789575608.431322:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:0.0:1789575608.431332:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+58:11604:x1876505676310400:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:0.0:1789575608.431588:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+59:11604:x1876505676310400:12345-192.168.202.32@tcp:35:bash.0 Request processed in 258us (1503us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789575608.431593:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789575608.485505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.485568:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310528 00000100:00100000:2.0:1789575608.485580:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310528 00000100:00100000:2.0:1789575608.485647:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 209 00000100:00100000:2.0:1789575608.485658:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+59:11610:x1876505676310528:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575608.485685:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575608.485709:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3a00/0xc45cc82a22383f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d2d expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485782:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485799:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485812:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575608.485881:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789575608.485885:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575608.485921:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485944:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3a00/0xc45cc82a22383f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d2d expref: 61 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485958:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d2d expref: 60 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.485964:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:2.0:1789575608.485967:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575608.485970:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3200, rc 0) 00000100:00100000:2.0:1789575608.486025:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676310528:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 370us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575608.486033:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 209 00000100:00100000:1.0:1789575608.489275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.489347:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310656 00000100:00100000:0.0:1789575608.489356:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310656 00000100:00100000:0.0:1789575608.489440:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:0.0:1789575608.489452:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676310656:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575608.489476:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575608.489503:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d34 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489571:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489598:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489609:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489622:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489627:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489631:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489789:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489796:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489801:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575608.489841:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789575608.489845:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575608.489876:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489887:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489902:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489907:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489913:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489917:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.489921:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489927:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489938:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575608.489940:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.489945:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489950:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383fa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489963:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489967:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489970:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489977:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575608.489979:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489983:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489987:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687dc9b00) 00010000:00010000:0.0:1789575608.489988:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575608.489990:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.489993:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.490017:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383f9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d34 expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.490029:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d34 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.490033:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.490034:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575608.490036:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:0.0:1789575608.490708:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11610:x1876505676310656:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1256us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.490715:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:1.0:1789575608.493844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575608.493922:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575608.493982:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676310912 00000100:00100000:3.0:1789575608.493995:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676310912 00000100:00100000:0.0:1789575608.494029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311040 00000100:00100000:0.0:1789575608.494049:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311040 00000100:00100000:3.0:1789575608.494079:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:3.0:1789575608.494091:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11610:x1876505676310912:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575608.494115:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575608.494142:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d3b expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.494262:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.494282:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 63 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.494292:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d34 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.494299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:3.0:1789575608.494301:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.494308:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+63:2357:x1876505676311040:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575608.494319:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575608.494337:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.494342:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.494348:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22383fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d34 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.494350:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.494357:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575608.494487:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.494503:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575608.494515:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699372160:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575608.494581:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+62:2357:x1876505676311040:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 274us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.494588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575608.494599:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789575608.496723:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699372160:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575608.496752:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575608.497063:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.497586:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311168 00000100:00100000:0.0:1789575608.497597:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311168 00010000:00010000:0.0:1789575608.497639:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575608.497669:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:0.0:1789575608.497676:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+62:2357:x1876505676311168:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575608.497794:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575608.497800:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497812:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497851:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a22383f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d26 expref: 62 pid: 7184 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497882:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.497886:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497894:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497900:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.497949:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575608.498021:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+61:2357:x1876505676311168:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 343us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.498029:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00010000:00010000:3.0:1789575608.499284:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.499299:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575608.499322:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789575608.499649:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22383fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 62 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.499666:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 61 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575608.499673:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575608.499696:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789575608.499699:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0800, rc 0) 00000100:00100000:3.0:1789575608.499759:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11610:x1876505676310912:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 5671us (5836us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789575608.499765:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:1.0:1789575608.502305:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575608.502398:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311424 00000100:00100000:2.0:1789575608.502408:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311424 00000100:00100000:2.0:1789575608.502499:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789575608.502512:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11610:x1876505676311424:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:2.0:1789575608.502531:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575608.502559:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a22383f20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d11 expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575608.502576:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575608.502581:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575608.502642:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676311424:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 133us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575608.502650:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789575608.506716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575608.507011:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311552 00000100:00100000:1.0:1789575608.507026:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311552 00000100:00100000:1.0:1789575608.507289:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:1.0:1789575608.507301:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676311552:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:1.0:1789575608.507459:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.507482:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575608.507498:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789575608.507737:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789575608.507846:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676311552:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 547us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575608.507866:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:1.0:1789575608.514139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575608.514778:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311680 00000100:00100000:0.0:1789575608.514791:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311680 00000100:00100000:0.0:1789575608.514977:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:0.0:1789575608.514988:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+60:11610:x1876505676311680:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575608.515013:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575608.515035:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d42 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.515106:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.515136:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.515156:0:5863:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.515170:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.517932:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575608.517942:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575608.517953:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575608.517970:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077e00, rc 0) 00000100:00100000:0.0:1789575608.518076:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11610:x1876505676311680:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3087us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575608.518086:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 213 00000040:00080000:0.0:1789575609.006077:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789575609.006094:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789575609.006193:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789575609.006203:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789575609.006404:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699372288:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789575609.006575:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789575609.014183:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.014283:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311808 00000100:00100000:3.0:1789575609.014297:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311808 00000100:00100000:3.0:1789575609.014431:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00100000:3.0:1789575609.014444:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676311808:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789575609.014484:0:7184:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789575609.014607:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676311808:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 166us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.014615:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00080000:1.0:1789575609.014774:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575609.015465:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699372288:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789575609.029009:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.029191:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676311936 00000100:00100000:2.0:1789575609.029203:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676311936 00000100:00100000:2.0:1789575609.029269:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:2.0:1789575609.029280:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11611:x1876505676311936:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789575609.029426:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029449:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029465:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029494:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029502:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029508:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029555:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029565:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.029572:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575609.029646:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789575609.029651:0:5864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575609.031074:0:5864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031109:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031118:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031127:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031134:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575609.031138:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031147:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031164:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:2.0:1789575609.031168:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575609.031174:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031180:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3600/0xc45cc82a22383fdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031200:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031230:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031237:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031242:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575609.031244:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031250:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031258:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e9683773e00) 00010000:00010000:2.0:1789575609.031261:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575609.031264:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031270:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3800/0xc45cc82a22383fe4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031288:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031293:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031298:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031303:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575609.031310:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031316:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031324:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575609.031326:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575609.031329:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.031335:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a22383feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.031477:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11611:x1876505676311936:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 2193us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.031486:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:2.0:1789575609.040625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.040830:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676312192 00000100:00100000:0.0:1789575609.040864:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676312192 00000100:00100000:0.0:1789575609.040933:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:0.0:1789575609.040944:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+61:11611:x1876505676312192:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575609.040967:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575609.040992:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383ff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d49 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041113:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041133:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041146:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575609.041158:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789575609.041285:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041293:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041300:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041308:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575609.041313:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041321:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041354:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575609.041357:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789575609.041363:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041652:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a22383ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041719:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383ff2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d49 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041730:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:0.0:1789575609.041733:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575609.041737:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22383ff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d49 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.041748:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575609.041957:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312192:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1340us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1789575609.041968:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:0.0:1789575609.053849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.053962:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676312320 00000100:00100000:2.0:1789575609.053973:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676312320 00000100:00100000:2.0:1789575609.054038:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:2.0:1789575609.054049:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312320:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789575609.054086:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789575609.054224:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312320:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.054231:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:1.0:1789575609.060096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.063246:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676312576 00000100:00100000:3.0:1789575609.063264:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676312576 00000100:00100000:3.0:1789575609.063345:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:3.0:1789575609.063355:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312576:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575609.063421:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575609.063425:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789575609.063452:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22383f97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d2d expref: 62 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.063472:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575609.063477:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575609.063491:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d50 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789575609.064868:0:9231:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789575609.065094:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238400e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.066767:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238400e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.066783:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238400e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.067020:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d50 expref: 64 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.067046:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238400e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d50 expref: 63 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.067056:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8b00) 00010000:00010000:3.0:1789575609.067059:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575609.067063:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1600, rc 0) 00000100:00100000:3.0:1789575609.068092:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+63:11611:x1876505676312576:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4734us (8004us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789575609.068108:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:3.0:1789575609.084546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.085318:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676312832 00000100:00100000:0.0:1789575609.085339:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676312832 00000100:00100000:0.0:1789575609.085431:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:0.0:1789575609.085445:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+63:11611:x1876505676312832:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789575609.085511:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575609.085543:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a2238400e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d50 expref: 63 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085578:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8b00) 00010000:00010000:0.0:1789575609.085590:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575609.085614:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085628:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085638:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085653:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085660:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085667:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085746:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085755:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085761:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085767:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575609.085772:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085788:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085797:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575609.085800:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575609.085804:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085809:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238401c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085821:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085828:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085833:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085837:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575609.085840:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085845:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085863:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc64a8105 (ffff8e9687dc9b00) 00010000:00010000:0.0:1789575609.085866:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575609.085869:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.085885:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a22384023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc64a8105 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.085966:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312832:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 525us (1447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575609.085974:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:1.0:1789575609.095861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.096019:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676312960 00000100:00100000:3.0:1789575609.096031:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676312960 00000100:00100000:3.0:1789575609.096094:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:3.0:1789575609.096106:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+62:11611:x1876505676312960:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575609.096142:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575609.096181:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238402a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d57 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096220:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096235:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096249:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096510:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238402a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 64 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096664:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 63 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.096674:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575609.096677:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789575609.096681:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:3.0:1789575609.096808:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+63:11611:x1876505676312960:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 697us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.096816:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:1.0:1789575609.107533:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.107616:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676313216 00000100:00100000:3.0:1789575609.107629:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676313216 00000100:00100000:3.0:1789575609.107697:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:3.0:1789575609.107707:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+63:11611:x1876505676313216:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789575609.107829:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.107861:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.107876:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575609.109668:0:9231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1789575609.109785:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b27b5e1 reply state 000000009ea17707 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.109825:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575609.110007:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+65:11611:x1876505676313216:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 2297us (2483us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789575609.110017:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:2.0:1789575609.119240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.119338:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676313344 00000100:00100000:0.0:1789575609.119348:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676313344 00000100:00100000:0.0:1789575609.119499:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:0.0:1789575609.119511:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+65:11611:x1876505676313344:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575609.119550:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575609.119575:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d5e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.119638:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 66 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.119653:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 66 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.119672:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:0.0:1789575609.119675:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575609.119679:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:0.0:1789575609.119779:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+66:11611:x1876505676313344:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 270us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.119787:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 222 00010000:00010000:1.0:1789575609.120086:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120097:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120103:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120109:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575609.120113:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120121:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120132:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:1.0:1789575609.120135:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789575609.120138:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.120144:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a22384038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575609.132969:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.133296:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676313472 00000100:00100000:2.0:1789575609.133307:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676313472 00000100:00080000:1.0:1789575609.133365:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575609.133416:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789575609.133428:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2358:x1876505676313472:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789575609.133755:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676313472:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 328us (794us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789575609.133764:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789575609.139513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.146396:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676313728 00000100:00100000:0.0:1789575609.146414:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676313728 00000100:00100000:0.0:1789575609.146505:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:0.0:1789575609.146515:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+65:11611:x1876505676313728:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789575609.146762:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+66:11611:x1876505676313728:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 248us (7264us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789575609.146770:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789575609.156257:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.156363:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676313984 00000100:00100000:0.0:1789575609.156396:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676313984 00000100:00100000:0.0:1789575609.156471:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:0.0:1789575609.156483:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+66:11611:x1876505676313984:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789575609.156837:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+66:11611:x1876505676313984:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 355us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.156845:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:2.0:1789575609.175617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575609.181411:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314112 00000100:00100000:1.0:1789575609.181429:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314112 00000100:00100000:1.0:1789575609.181510:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:1.0:1789575609.181521:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+66:11611:x1876505676314112:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789575609.181563:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575609.181587:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22384046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d65 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181664:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181680:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181691:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575609.181729:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789575609.181748:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181776:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87c00/0xc45cc82a22384046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d65 expref: 68 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181795:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d65 expref: 67 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.181804:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:1.0:1789575609.181807:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789575609.181811:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86800, rc 0) 00000100:00100000:1.0:1789575609.182242:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+67:11611:x1876505676314112:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 721us (6634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575609.182249:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:1.0:1789575609.194003:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.194109:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314240 00000100:00100000:2.0:1789575609.194121:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314240 00000100:00100000:2.0:1789575609.194205:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789575609.194216:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+10:2358:x1876505676314240:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575609.194241:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575609.194272:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d6c expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575609.194312:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaac1b9, blocks: 0x1 00010000:00010000:2.0:1789575609.194337:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1789575609.194361:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575609.194414:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 11 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.194438:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 11 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.194455:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3600, rc 0) 00000100:00100000:2.0:1789575609.194521:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc3db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2358:x1876505676314240:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 308us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.194528:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789575609.202406:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.202501:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314496 00000100:00100000:0.0:1789575609.202511:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314496 00000100:00100000:0.0:1789575609.202578:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 225 00000100:00100000:0.0:1789575609.202589:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+67:11611:x1876505676314496:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789575609.202703:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+67:11611:x1876505676314496:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 115us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.202711:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 225 00000100:00100000:1.0:1789575609.209447:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.209560:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314624 00000100:00100000:2.0:1789575609.209574:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314624 00000100:00100000:2.0:1789575609.209643:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:2.0:1789575609.209654:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+11:11611:x1876505676314624:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575609.209675:0:9232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575609.209695:0:9232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d73 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.209728:0:9232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.209738:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575609.209743:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575609.209748:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 12 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.209800:0:9232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.209815:0:9232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.209829:0:9232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699372416:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575609.209998:0:9232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b0d80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575609.219407:0:9232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699372416:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575609.219448:0:9232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 12 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.219472:0:9232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2200, rc 0) 00000100:00100000:2.0:1789575609.219538:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+12:11611:x1876505676314624:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 9885us (10105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.219548:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:3.0:1789575609.219739:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.220008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314752 00000100:00100000:0.0:1789575609.220017:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314752 00010000:00010000:0.0:1789575609.220053:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.220162:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:0.0:1789575609.220180:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969df02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+12:2357:x1876505676314752:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575609.220196:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575609.220220:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.220233:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.220259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a22384054 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d6c expref: 12 pid: 6709 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.220274:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575609.220278:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575609.220286:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 11 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.220295:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 11 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.220329:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 11 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.220343:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1876505699372544:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789575609.220456:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690a8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789575609.226111:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1876505699372544:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789575609.226141:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575609.226214:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969df02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2357:x1876505676314752:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 6043us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.226226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789575609.234290:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.234415:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676314880 00000100:00100000:3.0:1789575609.234427:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676314880 00002000:00100000:3.0:1789575609.234487:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e96bd2ebb80 x1876505676314880/t0(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:630/0 lens 504/0 e 0 to 0 dl 1789575620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575609.234500:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bd2ebb80 with x1876505676314880 ext(0->12) 00002000:00010000:3.0:1789575609.234507:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bd2ebb80 00000100:00100000:3.0:1789575609.234544:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575609.234556:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+11:2357:x1876505676314880:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789575609.235056:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd2ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2357:x1876505676314880:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 501us (775us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789575609.235064:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00002000:00100000:3.0:1789575609.235072:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e96bd2ebb80 x1876505676314880/t4294967321(0) o4->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:630/0 lens 504/448 e 0 to 0 dl 1789575620 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789575609.235080:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bd2ebb80 with x1876505676314880 ext(0->12) 00002000:00010000:3.0:1789575609.235084:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bd2ebb80 00000100:00100000:1.0:1789575609.253468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.260093:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315008 00000100:00100000:2.0:1789575609.260110:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315008 00000100:00100000:2.0:1789575609.260594:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00100000:2.0:1789575609.260608:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+67:11611:x1876505676315008:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789575609.320590:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789575609.413861:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1789575609.413909:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789575609.413937:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9690a8d6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789575609.413942:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bcff8d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9690a8d240 00000020:00080000:0.0:1789575609.413945:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bcff8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bbe4b000 00000020:00080000:0.0:1789575609.414024:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e96865070c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789575609.414028:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e968952ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9686507480 00000020:00080000:0.0:1789575609.414031:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e968952c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e95876e9c00 00000004:00080000:0.0:1789575609.414051:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789575609.414081:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1789575609.414699:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699372672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789575609.414772:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789575609.414952:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789575609.415644:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789575609.415924:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575609.415938:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699372800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789575609.415988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575609.416855:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11611:x1876505676315008:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 156236us (163384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.416868:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00100000:1.0:1789575609.418142:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699372672 00000100:00100000:1.0:1789575609.418320:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699372672 00000100:00100000:1.0:1789575609.418732:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699372800 00000100:00100000:1.0:1789575609.418737:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699372800 00000100:00100000:1.0:1789575609.418785:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789575609.418800:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699372672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789575609.418860:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1789575609.418898:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.418930:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.418941:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789575609.418946:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575609.418952:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.419012:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.419032:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 12 pid: 6706 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575609.419076:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699372928:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575609.419574:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0d62300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575609.419759:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789575609.419777:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699372800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789575609.419801:0:9232:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789575609.419841:0:9232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaac1b8, atime: 0x0, ctime: 0x6aaac1b8, blocks: 0xb 00010000:00010000:3.0:1789575609.419858:0:9232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.419871:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1789575609.419875:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575609.419880:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.419896:0:9232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.419906:0:9232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.419913:0:9232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.419928:0:9232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789575609.420972:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876505699372800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1199us (4979us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789575609.420992:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1789575609.421360:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575609.421386:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.421399:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575609.421623:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.421637:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.421660:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.421669:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001095db04/0xc45cc82a22384069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.421692:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.421694:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.421696:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575609.422486:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1789575609.422497:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1789575609.422521:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bbd07100, transno 4294967307 00000004:00080000:3.0:1789575609.422536:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1789575609.422554:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e96bb5b7800 x1876505699372800/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789575625 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789575609.422566:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bb5b7800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789575609.422572:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699372800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789575609.430698:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6708:1876505699372928:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575609.430739:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.430910:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575609.431419:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315136 00000100:00100000:1.0:1789575609.431429:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315136 00010000:00010000:1.0:1789575609.431475:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 13 pid: 6706 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575609.431555:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:1.0:1789575609.431568:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+13:2358:x1876505676315136:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575609.431592:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575609.431598:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 13 pid: 6706 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.431613:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 13 pid: 6706 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.431643:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a22383e24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cd2 expref: 13 pid: 6706 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.431663:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575609.431667:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789575609.431674:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.431684:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.431726:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575609.431800:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+12:2358:x1876505676315136:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 234us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575609.431808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00010000:00010000:3.0:1789575609.433297:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.433317:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.433330:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.433338:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.433414:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789575609.434622:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575609.434634:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.434646:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe86600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575609.434651:0:8472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.434662:0:8472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.434683:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.434692:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3910f79/0xc45cc82a22384062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.434719:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.434721:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.434723:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575609.436628:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876505699372672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17821us (21845us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789575609.436644:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789575609.436738:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e958661bb80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789575609.436806:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699372672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789575609.441342:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.441556:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315264 00000100:00100000:2.0:1789575609.441571:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315264 00000100:00100000:2.0:1789575609.441665:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789575609.441676:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+12:2358:x1876505676315264:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789575609.492516:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789575609.492545:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1789575609.492551:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789575609.492860:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676315264:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 51167us (51511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.492875:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789575609.498711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575609.502972:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315520 00000100:00100000:1.0:1789575609.503075:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315520 00000100:00100000:2.0:1789575609.508591:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 227 00000100:00100000:2.0:1789575609.508616:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11611:x1876505676315520:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575609.508710:0:9231:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575609.508749:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86800/0xc45cc82a2238404d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d65 expref: 20 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.509630:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575609.509642:0:9231:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575609.509697:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.509718:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.509732:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575609.511036:0:9231:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006155607e reply state 00000000c8a5ee5c transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.511053:0:9231:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575609.511256:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+21:11611:x1876505676315520:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 2642us (12555us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789575609.511266:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 227 00010000:00010000:2.0:1789575609.522253:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522276:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522284:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522291:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575609.522297:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522305:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522325:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575609.522329:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575609.522334:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.522341:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2c00/0xc45cc82a22384070 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.527207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.527421:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315648 00000100:00100000:3.0:1789575609.527437:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315648 00000100:00100000:3.0:1789575609.527507:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:3.0:1789575609.527519:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676315648:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789575609.527835:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789575609.527838:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789575608 00002000:00010000:3.0:1789575609.527841:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789575608 00002000:00010000:3.0:1789575609.527842:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789575609 -> 1789575608 00002000:00010000:3.0:1789575609.527844:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789575609.527943:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676315648:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 417us (747us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789575609.527952:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:0.0:1789575609.547929:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.548467:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676315904 00000100:00100000:3.0:1789575609.548481:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676315904 00000100:00100000:3.0:1789575609.548554:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:3.0:1789575609.548566:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+20:11611:x1876505676315904:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789575609.548657:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.548694:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 20 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.548706:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.548748:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 20 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.548764:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 20 pid: 5864 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.548778:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699373056:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575609.548909:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575609.560296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.560668:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699373056:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575609.560704:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.560709:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316032 00000100:00100000:2.0:1789575609.560718:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316032 00010000:00010000:2.0:1789575609.560769:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 21 pid: 5864 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.560857:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:2.0:1789575609.560870:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+21:2357:x1876505676316032:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575609.560890:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575609.560898:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 21 pid: 5864 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.560911:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 21 pid: 5864 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.560954:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0200/0xc45cc82a22384031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d57 expref: 21 pid: 5864 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.560976:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575609.560981:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.560993:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.561010:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.561044:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575609.561067:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561085:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.561116:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+20:2357:x1876505676316032:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 249us (836us total) trans 0 rc 0/0 00010000:00010000:3.0:1789575609.561124:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.561124:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00010000:00010000:3.0:1789575609.561131:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561146:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561152:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575609.561157:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561178:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561188:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:3.0:1789575609.561191:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789575609.561196:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.561202:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a22384077 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.561247:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11611:x1876505676315904:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 12684us (13333us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789575609.561255:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:0.0:1789575609.569323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.569512:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316160 00000100:00100000:3.0:1789575609.569526:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316160 00000100:00100000:3.0:1789575609.569602:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:3.0:1789575609.569614:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2355:x1876505676316160:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789575609.569677:0:9232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.569699:0:9232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.569726:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575609.569731:0:9232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575609.569736:0:9232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.569777:0:9232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 8 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.569794:0:9232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 8 pid: 9232 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.569827:0:9232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699373184:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575609.569960:0:9232:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575609.574856:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.575438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316288 00000100:00100000:0.0:1789575609.575452:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316288 00010000:00010000:0.0:1789575609.575523:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 9 pid: 9232 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.575577:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:0.0:1789575609.575588:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676316288:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575609.575607:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575609.575639:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 9 pid: 9232 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.575657:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 9 pid: 9232 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.575692:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575609.575698:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575609.575705:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.575718:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.575742:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575609.575823:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+9:2357:x1876505676316288:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 236us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.575832:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 83 00010000:00010000:3.0:1789575609.576812:0:9232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238405b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d73 expref: 8 pid: 9232 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.576844:0:9232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9232:1876505699373184:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575609.576883:0:9232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576896:0:9232:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576904:0:9232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576956:0:9232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576966:0:9232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576976:0:9232:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.576985:0:9232:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575609.576991:0:9232:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.577004:0:9232:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.577024:0:9232:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.577032:0:9232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a2238407e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.577136:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2355:x1876505676316160:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 7523us (7844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.577147:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:1.0:1789575609.593295:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.599619:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316544 00000100:00100000:2.0:1789575609.599664:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316544 00000100:00100000:0.0:1789575609.606718:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 229 00000100:00100000:0.0:1789575609.606736:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11611:x1876505676316544:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789575609.606865:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.606889:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.606905:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.607838:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.607872:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.607883:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.608729:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.608755:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 20 pid: 5863 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.608775:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699373312:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575609.608923:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0e549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575609.625134:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.628885:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316672 00000100:00100000:2.0:1789575609.628913:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316672 00010000:00010000:2.0:1789575609.629014:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 21 pid: 5863 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575609.629109:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:2.0:1789575609.629124:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+21:2357:x1876505676316672:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575609.629145:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575609.629154:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 21 pid: 5863 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.629170:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 21 pid: 5863 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.629209:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:2.0:1789575609.629213:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.629222:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.629228:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575609.629250:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575609.629632:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+21:2357:x1876505676316672:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 509us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575609.629643:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00010000:00010000:0.0:1789575609.629992:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076000/0xc45cc82a2238403f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d5e expref: 20 pid: 5863 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.630015:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699373312:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575609.630072:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.630095:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.630102:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575609.630353:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789575609.630580:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789575609.630631:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789575609.630722:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699373440:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789575609.630782:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575609.631095:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699c60780 going to sleep for 11 seconds 00000100:00100000:0.0:1789575609.631123:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699373440 00000100:00100000:0.0:1789575609.631132:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699373440 00000100:00100000:0.0:1789575609.631190:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789575609.631200:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699373440:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789575609.631284:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699373440:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.631291:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789575609.631543:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789575609.631551:0:5862:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789575609.631570:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e958661bb80, transno 4294967322 00000100:00100000:0.0:1789575609.631584:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699373440:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789575609.633724:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789575609.633861:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699373568:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789575609.633957:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575609.633998:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658300 going to sleep for 11 seconds 00000100:00100000:0.0:1789575609.635229:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699373568 00000100:00100000:0.0:1789575609.635245:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699373568 00000100:00100000:0.0:1789575609.635347:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789575609.635406:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1876505699373568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789575609.635743:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5862:x1876505699373568:12345-0@lo:1000:mdt00_000.0 Request processed in 341us (1785us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789575609.635754:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575609.636883:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5862:1876505699373568:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789575609.636948:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.636961:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.636970:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.636976:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575609.636982:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.636990:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637009:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8f00) 00010000:00010000:1.0:1789575609.637013:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575609.637019:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637025:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2076400/0xc45cc82a2238408c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637092:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637099:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637106:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637111:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575609.637114:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637121:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637131:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:1.0:1789575609.637134:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575609.637143:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637157:0:5862:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637168:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.637216:0:5862:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575609.637248:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699373696:192.168.202.32@tcp:105: 00000100:00100000:1.0:1789575609.637786:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658300 going to sleep for 11 seconds 00000100:00100000:1.0:1789575609.646822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.647013:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5862:1876505699373696:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789575609.647055:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647068:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a22383fcf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647107:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647121:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647137:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647153:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647160:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647167:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647173:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575609.647178:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647208:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647222:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575609.647225:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575609.647230:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647237:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a22384093 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647251:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647257:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647262:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647266:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575609.647269:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647274:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647282:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575609.647284:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789575609.647287:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.647306:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.647656:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+23:11611:x1876505676316544:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 40922us (54375us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789575609.647668:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 229 00000020:00080000:0.0:1789575609.647678:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789575609.647793:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676316800 00000100:00100000:3.0:1789575609.647815:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676316800 00000100:00100000:3.0:1789575609.647895:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:3.0:1789575609.647909:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:11610:x1876505676316800:12345-192.168.202.32@tcp:49:lfs.0 00000100:00100000:3.0:1789575609.648053:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:11610:x1876505676316800:12345-192.168.202.32@tcp:49:lfs.0 Request processed in 148us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.648061:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000040:00080000:1.0:1789575609.648888:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789575609.648897:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789575609.650302:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789575609.650318:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789575609.659306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.659564:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317056 00000100:00100000:3.0:1789575609.659576:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317056 00000100:00100000:3.0:1789575609.659647:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:3.0:1789575609.659658:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969078a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+23:11611:x1876505676317056:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789575609.660751:0:5866:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789575609.660873:0:5866:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1789575609.660932:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.660951:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.660966:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.660976:0:5866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.660982:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.660988:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.661973:0:5866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789575609.662143:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969078a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+25:11611:x1876505676317056:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 2480us (2842us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789575609.662157:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000020:00080000:3.0:1789575609.662171:0:5866:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789575609.673108:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575609.673130:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.673145:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575609.673150:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.673163:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.673196:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9687bd8c00) 00010000:00010000:1.0:1789575609.673200:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789575609.673208:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.673214:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a2238409a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5866 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575609.673244:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.673246:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575609.673248:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575609.676558:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575609.681656:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317312 00000100:00100000:2.0:1789575609.681704:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317312 00000100:00100000:3.0:1789575609.684725:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:3.0:1789575609.684741:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+25:11610:x1876505676317312:12345-192.168.202.32@tcp:58:lfs.0 00000040:00080000:3.0:1789575609.685085:0:9231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789575609.685214:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e95876ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+25:11610:x1876505676317312:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 475us (8668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.685222:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:0.0:1789575609.766875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575609.767043:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317440 00000100:00100000:3.0:1789575609.767060:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317440 00000100:00100000:3.0:1789575609.767149:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 231 00000100:00100000:3.0:1789575609.767173:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+25:11613:x1876505676317440:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575609.767201:0:7184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575609.767227:0:7184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d7a expref: -99 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767329:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767344:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767357:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767478:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767487:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767494:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767750:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767761:0:7184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 26 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767771:0:7184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767826:0:7184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 26 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.767854:0:7184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 26 pid: 7184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575609.767872:0:7184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699373824:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789575609.767988:0:7184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789575609.776539:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.776870:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317696 00000100:00100000:0.0:1789575609.776883:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317696 00000100:00100000:0.0:1789575609.776978:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:0.0:1789575609.776992:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:5599:x1876505676317696:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789575609.777331:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+28:5599:x1876505676317696:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 341us (802us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789575609.777341:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789575609.779041:0:7184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7184:1876505699373824:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575609.779097:0:7184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575609.782652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575609.782917:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317824 00000100:00100000:0.0:1789575609.782932:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317824 00010000:00010000:0.0:1789575609.782983:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 28 pid: 7184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575609.783032:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:0.0:1789575609.783044:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+28:2358:x1876505676317824:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575609.783061:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575609.783068:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 28 pid: 7184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783568:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 28 pid: 7184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783594:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0800/0xc45cc82a22383fc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d3b expref: 28 pid: 7184 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783613:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575609.783619:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783629:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783637:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575609.783671:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575609.783731:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+27:2358:x1876505676317824:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 689us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575609.783740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00010000:00010000:3.0:1789575609.784576:0:7184:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784586:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575609.784630:0:7184:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789575609.784634:0:7184:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789575609.784654:0:7184:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784667:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784678:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784684:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784691:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784697:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575609.784700:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784708:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784718:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:3.0:1789575609.784731:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575609.784736:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784743:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d1600/0xc45cc82a223840a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784756:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784762:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784768:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784773:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575609.784776:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784782:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784789:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9687bd8600) 00010000:00010000:3.0:1789575609.784791:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575609.784869:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784876:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784920:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d7a expref: 27 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784948:0:7184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d7a expref: 26 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575609.784955:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575609.784957:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575609.784960:0:7184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0600, rc 0) 00000100:00100000:3.0:1789575609.785013:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11613:x1876505676317440:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 17853us (18151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575609.785022:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 231 00010000:00010000:1.0:1789575610.344552:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789575610.666927:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789575610.666935:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789575610.666993:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789575610.667002:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789575610.667123:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699373952:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789575610.667225:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575610.691657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575610.691738:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11713:1876505699373952:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575610.691882:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676317952 00000100:00100000:3.0:1789575610.691891:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676317952 00000100:00100000:3.0:1789575610.691962:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:3.0:1789575610.691974:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11624:x1876505676317952:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789575610.692015:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789575610.692128:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11624:x1876505676317952:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 155us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575610.692135:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:3.0:1789575610.696127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575610.696238:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676318208 00000100:00100000:0.0:1789575610.696250:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676318208 00000100:00100000:0.0:1789575610.696321:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:0.0:1789575610.696333:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+26:11624:x1876505676318208:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575610.696364:0:5864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575610.696436:0:5864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223840bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d81 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575610.696546:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575610.696574:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575610.696603:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575610.696617:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789575610.696881:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a223840bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d81 expref: 29 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575610.696916:0:5864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d81 expref: 28 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575610.696930:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575610.696935:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575610.696940:0:5864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2157c00, rc 0) 00000100:00100000:0.0:1789575610.697057:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11624:x1876505676318208:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 721us (938us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789575610.697072:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:0.0:1789575610.712130:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575610.713229:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676318464 00000100:00100000:3.0:1789575610.713243:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676318464 00000100:00100000:3.0:1789575610.713340:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:3.0:1789575610.713354:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11624:x1876505676318464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789575610.713502:0:7184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713543:0:7184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713557:0:7184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713778:0:7184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713786:0:7184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713793:0:7184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713798:0:7184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575610.713802:0:7184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713810:0:7184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713823:0:7184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575610.713827:0:7184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789575610.713831:0:7184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.713850:0:7184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7184 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575610.714026:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11624:x1876505676318464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 673us (1906us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789575610.714042:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 234 00000040:00080000:2.0:1789575610.714681:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575610.714687:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575610.715172:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789575610.715186:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789575610.738715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575610.740625:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676318592 00000100:00100000:3.0:1789575610.740645:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676318592 00000100:00100000:3.0:1789575610.740718:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789575610.740727:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+29:2358:x1876505676318592:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575610.740752:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575610.740778:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d81 expref: 29 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575610.740796:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575610.740801:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575610.741040:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+28:2358:x1876505676318592:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 313us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575610.741047:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789575610.741703:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575610.741844:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676318848 00000100:00100000:2.0:1789575610.741851:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676318848 00000100:00100000:2.0:1789575610.741899:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789575610.741909:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+28:11624:x1876505676318848:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789575610.742186:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11624:x1876505676318848:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 273us (480us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789575610.742201:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000040:00080000:1.0:1789575611.230882:0:12492:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789575611.230895:0:12492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789575611.230955:0:12492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789575611.230969:0:12492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789575611.368526:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575611.536249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575611.536468:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319104 00000100:00100000:3.0:1789575611.536483:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319104 00000100:00100000:3.0:1789575611.536578:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 235 00000100:00100000:3.0:1789575611.536594:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+29:11638:x1876505676319104:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789575611.536621:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575611.536644:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d88 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575611.536746:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575611.536778:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575611.536790:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575611.536807:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789575611.537057:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0a00/0xc45cc82a223840d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d88 expref: 32 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575611.537094:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d88 expref: 31 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575611.537102:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575611.537105:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789575611.537109:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0400, rc 0) 00000100:00100000:3.0:1789575611.537175:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:22a2b54c-4bca-4302-892e-490c3310b8b3+31:11638:x1876505676319104:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 587us (936us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789575611.537182:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 235 00000100:00080000:1.0:1789575611.537399:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575611.547215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575611.547338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575611.547397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575611.547427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575611.547856:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319232 00000100:00100000:0.0:1789575611.547868:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319232 00000100:00100000:0.0:1789575611.547922:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 306 00000100:00100000:0.0:1789575611.547931:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676319232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575611.548017:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676319232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 87us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575611.548026:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 306 00000100:00100000:0.0:1789575611.551604:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319616 00000100:00100000:0.0:1789575611.551623:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319616 00000100:00100000:0.0:1789575611.551715:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:0.0:1789575611.551729:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676319616:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575611.551822:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676319616:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 97us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575611.551839:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00080000:1.0:1789575611.552452:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575611.552512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575611.552535:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319744 00000100:00100000:1.0:1789575611.552541:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319744 00000100:00100000:1.0:1789575611.552573:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:1.0:1789575611.552581:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+31:11638:x1876505676319744:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:1.0:1789575611.552640:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552659:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552689:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552718:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552725:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552742:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552748:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575611.552752:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552760:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552772:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:1.0:1789575611.552774:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575611.552779:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575611.552784:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223840ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575611.552837:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+31:11638:x1876505676319744:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 247us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575611.552844:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:2.0:1789575611.560573:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319360 00000100:00100000:2.0:1789575611.560595:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319360 00000100:00100000:2.0:1789575611.565683:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319488 00000100:00100000:2.0:1789575611.565700:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319488 00000100:00100000:2.0:1789575611.565759:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:2.0:1789575611.565772:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2357:x1876505676319360:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575611.565873:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2357:x1876505676319360:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 103us (18673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575611.565880:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:2.0:1789575611.565900:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:2.0:1789575611.565907:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676319488:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575611.565934:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676319488:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (18507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575611.565957:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00080000:1.0:1789575611.572062:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575611.572091:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789575611.756591:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575611.756747:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676319872 00000100:00100000:2.0:1789575611.756758:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676319872 00000100:00100000:2.0:1789575611.756820:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:2.0:1789575611.756842:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2358:x1876505676319872:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789575611.756861:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575611.756883:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223840f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d8f expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575611.756911:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aaac1b8, atime: 0x6aaac1b8, ctime: 0x6aaac1b8, blocks: 0xb 00010000:00010000:2.0:1789575611.756931:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1789575611.756935:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575611.756945:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223840f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d8f expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575611.756961:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223840f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d8f expref: 8 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575611.756975:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2600, rc 0) 00000100:00100000:2.0:1789575611.757038:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2358:x1876505676319872:12345-192.168.202.32@tcp:101:cat.0 Request processed in 199us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575611.757045:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:0.0:1789575611.765200:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575611.766180:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320000 00000100:00100000:2.0:1789575611.766196:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320000 00002000:00100000:2.0:1789575611.766271:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e96bbe94380 x1876505676320000/t0(0) o3->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:632/0 lens 488/0 e 0 to 0 dl 1789575622 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789575611.766306:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbe94380 with x1876505676320000 ext(0->4095) 00002000:00010000:2.0:1789575611.766312:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bbe94380 00000100:00100000:2.0:1789575611.768258:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789575611.768283:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676320000:12345-192.168.202.32@tcp:3:cat.0 00000100:00100000:2.0:1789575611.768674:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+8:2357:x1876505676320000:12345-192.168.202.32@tcp:3:cat.0 Request processed in 398us (3486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789575611.768690:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00002000:00100000:2.0:1789575611.768709:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e96bbe94380 x1876505676320000/t0(0) o3->22a2b54c-4bca-4302-892e-490c3310b8b3@192.168.202.32@tcp:632/0 lens 488/4536 e 0 to 0 dl 1789575622 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789575611.768724:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e96bbe94380 with x1876505676320000 ext(0->4095) 00002000:00010000:2.0:1789575611.768733:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e96bbe94380 00000100:00100000:2.0:1789575611.816678:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699374080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575611.816777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575611.817196:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374080 00000100:00100000:0.0:1789575611.817205:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374080 00000100:00100000:0.0:1789575611.817282:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789575611.817292:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699374080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575611.817340:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575611.817436:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699374080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575611.817444:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789575611.817498:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699374080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575611.817570:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789575612.392673:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575612.844451:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699374464:0@lo:400:kworker.0 00000100:00100000:3.0:1789575612.844548:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575612.844620:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789575612.844626:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699374336:0@lo:400:kworker.0 00000100:00100000:3.0:1789575612.844689:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575612.844707:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699374848:0@lo:400:kworker.0 00000100:00100000:3.0:1789575612.844732:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575612.844785:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374464 00000100:00100000:3.0:1789575612.844794:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374464 00000100:00100000:3.0:1789575612.844865:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374336 00000100:00100000:3.0:1789575612.844868:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374336 00000100:00100000:3.0:1789575612.844891:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789575612.844899:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699374464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575612.844956:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876505699374464:12345-0@lo:400:kworker.0 Request processed in 58us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575612.844963:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789575612.845217:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789575612.845227:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699374336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.845277:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699374336:12345-0@lo:400:kworker.0 Request processed in 52us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575612.845283:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1789575612.845307:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575612.845343:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374848 00000100:00100000:1.0:1789575612.845347:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374848 00000100:00100000:1.0:1789575612.845421:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789575612.845429:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699374848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.845462:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699374848:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575612.845468:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1789575612.845486:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575612.845545:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699374336:0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.845558:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699374848:0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.845568:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876505699374464:0@lo:400:kworker.0 00000100:00100000:2.0:1789575612.845740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699374208:0@lo:400:kworker.0 00000100:00100000:2.0:1789575612.845778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575612.845826:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699374720:0@lo:400:kworker.0 00000100:00100000:2.0:1789575612.845850:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575612.845870:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575612.845876:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699374592:0@lo:400:kworker.0 00000100:00100000:2.0:1789575612.845897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575612.845926:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374592 00000100:00100000:2.0:1789575612.845930:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374592 00000100:00100000:2.0:1789575612.845957:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789575612.845989:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699374592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575612.846026:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699374592:12345-0@lo:400:kworker.0 Request processed in 39us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575612.846032:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789575612.846058:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699374592:0@lo:400:kworker.0 00000100:00100000:0.0:1789575612.846474:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374720 00000100:00100000:0.0:1789575612.846480:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374720 00000100:00100000:0.0:1789575612.846542:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789575612.846549:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699374720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575612.846603:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699374720:12345-0@lo:400:kworker.0 Request processed in 55us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575612.846618:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789575612.846661:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699374720:0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.846845:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374208 00000100:00100000:1.0:1789575612.846850:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374208 00000100:00100000:1.0:1789575612.846887:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789575612.846895:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699374208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575612.846942:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3307:x1876505699374208:12345-0@lo:400:kworker.0 Request processed in 49us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575612.846956:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789575612.847013:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699374208:0@lo:400:kworker.0 00000100:00080000:2.0:1789575612.847286:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789575613.353033:0:7870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425439659041ns, next at 426439655951ns, rc = 0 00000100:00100000:1.0:1789575613.353074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699374976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575613.353163:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575613.353286:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699374976 00000100:00100000:2.0:1789575613.353294:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699374976 00000100:00100000:2.0:1789575613.353429:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789575613.353438:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699374976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575613.353472:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575613.353520:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876505699374976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575613.353527:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789575613.353719:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958682ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699374976:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789575613.396198:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1789575613.418138:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789575613.804175:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789575613.804187:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575613.804467:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789575613.804475:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789575614.427526:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1789575614.427666:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e96bb78cc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789575614.427672:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bcff8a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bb78c540 00000020:00080000:0.0:1789575614.427677:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e96bcff8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e96bb586000 00000020:00080000:3.0:1789575614.427723:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1789575614.428001:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1789575614.428196:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:0.0:1789575614.428221:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:0.0:1789575614.428231:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789575614.428246:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:0.0:1789575614.428511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699375104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789575614.428866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575614.429215:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375104 00000100:00100000:1.0:1789575614.429225:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375104 00000100:00100000:1.0:1789575614.429451:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789575614.429461:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699375104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789575614.429640:0:9232:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789575614.429644:0:9232:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789575608 -> 1789575608 00002000:00010000:1.0:1789575614.429647:0:9232:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789575608 -> 1789575608 00002000:00010000:1.0:1789575614.429649:0:9232:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789575608 -> 1789575608 00002000:00010000:1.0:1789575614.429652:0:9232:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789575614.429703:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbe95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876505699375104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (837us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789575614.429711:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:1.0:1789575614.429762:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96bbcaad80/2, rc 0, transno 4294967325 00000100:00100000:1.0:1789575614.429767:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699375104:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789575614.430349:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789575614.440523:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789575614.931721:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789575614.932050:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1789575614.933339:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1789575615.464590:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575616.488603:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575616.654034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575616.654076:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575616.654110:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575616.654133:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575616.654154:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575616.654185:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320640 00000100:00100000:1.0:1789575616.654195:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320640 00000100:00100000:1.0:1789575616.654245:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320256 00000100:00100000:1.0:1789575616.654248:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320256 00000100:00100000:1.0:1789575616.654272:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:1.0:1789575616.654280:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676320640:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575616.654367:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2358:x1876505676320640:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575616.654403:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:1.0:1789575616.654421:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:1.0:1789575616.654437:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2357:x1876505676320256:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575616.654472:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2357:x1876505676320256:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575616.654480:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:1.0:1789575616.654501:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320384 00000100:00100000:1.0:1789575616.654504:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320384 00000100:00100000:1.0:1789575616.654526:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320512 00000100:00100000:1.0:1789575616.654529:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320512 00000100:00100000:1.0:1789575616.654547:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:1.0:1789575616.654553:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676320384:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575616.654591:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2358:x1876505676320384:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 37us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575616.654615:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:1.0:1789575616.654627:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:1.0:1789575616.654631:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676320512:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575616.654736:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320128 00000100:00100000:0.0:1789575616.654741:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320128 00000100:00100000:0.0:1789575616.654773:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 308 00000100:00100000:0.0:1789575616.654791:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676320128:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575616.654829:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9131551-6e4d-4261-8037-131b911dfc86+13:2358:x1876505676320128:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 49us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575616.654835:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 308 00000100:00100000:1.0:1789575616.655146:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676320512:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 513us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575616.655153:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00080000:1.0:1789575616.655171:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575616.655176:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789575616.655178:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575616.936790:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575616.936821:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699375232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575616.936916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575616.937009:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375232 00000100:00100000:3.0:1789575616.937018:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375232 00000100:00100000:3.0:1789575616.937072:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789575616.939835:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699375232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575616.939887:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575616.939994:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699375232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2914us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575616.940004:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789575616.940055:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575616.940199:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789575616.940206:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bb5b7800, transno 4294967310 00000100:00100000:0.0:1789575616.940238:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699375232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575617.514167:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575617.960831:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699375744:0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.960915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575617.960989:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575617.960995:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699375616:0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.961020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575617.961048:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375744 00000100:00100000:1.0:1789575617.961056:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375744 00000100:00100000:2.0:1789575617.961179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699375360:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.961211:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575617.961235:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699375872:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.961264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575617.961281:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575617.961286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699375488:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.961318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575617.961333:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699376000:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.961358:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575617.961408:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375616 00000100:00100000:3.0:1789575617.961412:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375616 00000100:00100000:3.0:1789575617.961448:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375872 00000100:00100000:3.0:1789575617.961450:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375872 00000100:00100000:3.0:1789575617.961465:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375488 00000100:00100000:3.0:1789575617.961467:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375488 00000100:00100000:3.0:1789575617.961488:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789575617.961496:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575617.961550:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699375616:12345-0@lo:400:kworker.0 Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575617.961557:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789575617.961573:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789575617.961579:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699375872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575617.961603:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699375872:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575617.961609:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789575617.961619:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789575617.961625:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699375488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575617.961647:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699375488:12345-0@lo:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575617.961653:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1789575617.961666:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575617.961695:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699375616:0@lo:400:kworker.0 00000100:00100000:3.0:1789575617.961728:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699375360 00000100:00100000:3.0:1789575617.961731:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699375360 00000100:00100000:3.0:1789575617.961753:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789575617.961758:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575617.961795:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3308:x1876505699375360:12345-0@lo:400:kworker.0 Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575617.961800:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789575617.966075:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699375360:0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.967944:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376000 00000100:00100000:1.0:1789575617.967962:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376000 00000100:00100000:2.0:1789575617.968036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699375872:0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.968069:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789575617.968079:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699375744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.968220:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699375744:12345-0@lo:400:kworker.0 Request processed in 140us (7304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575617.968228:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789575617.968247:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789575617.968253:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699376000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.968307:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699376000:12345-0@lo:400:kworker.0 Request processed in 53us (6945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575617.968312:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789575617.968343:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789575617.968404:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699375744:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.968734:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699375488:0@lo:400:kworker.0 00000100:00100000:2.0:1789575617.968750:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789575617.968755:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:2.0:1789575617.968782:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96bbcaad80, transno 4294967325 00000100:00100000:2.0:1789575617.968803:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699376000:0@lo:400:kworker.0 00000100:00100000:1.0:1789575617.991553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575617.991736:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676320768 00000100:00100000:3.0:1789575617.991748:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676320768 00000100:00100000:3.0:1789575617.991863:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 237 00000100:00100000:3.0:1789575617.991877:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11299:x1876505676320768:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789575617.992013:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11299:x1876505676320768:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 139us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575617.992022:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 237 00000100:00100000:1.0:1789575618.010232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575618.016477:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321024 00000100:00100000:3.0:1789575618.016490:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321024 00000100:00080000:1.0:1789575618.026195:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575618.026196:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789575618.026214:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+18:11299:x1876505676321024:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789575618.026615:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:11299:x1876505676321024:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 406us (16392us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789575618.026622:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789575618.472863:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575618.472885:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699376128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575618.472949:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575618.473104:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376128 00000100:00100000:3.0:1789575618.473113:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376128 00000100:00100000:3.0:1789575618.473167:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789575618.473177:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699376128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575618.473218:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575618.473265:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699376128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575618.473272:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789575618.473317:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699376128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575618.537196:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575619.565084:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789575619.573910:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789575619.573939:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789575619.573998:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789575619.574021:0:5895:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789575620.584551:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789575620.595826:0:12694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:20:18 (1789575618) 00010000:00010000:1.0:1789575621.615332:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575621.784404:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575621.784526:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575621.784569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575621.784597:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575621.784625:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575621.784672:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321152 00000100:00100000:3.0:1789575621.784681:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321408 00000100:00100000:0.0:1789575621.784684:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321152 00000100:00100000:3.0:1789575621.784689:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321408 00000100:00100000:3.0:1789575621.784751:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321536 00000100:00100000:3.0:1789575621.784755:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321536 00000100:00100000:0.0:1789575621.784756:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 310 00000100:00100000:0.0:1789575621.784770:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676321152:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575621.784789:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789575621.784801:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2357:x1876505676321408:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575621.784848:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2357:x1876505676321408:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575621.784849:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9131551-6e4d-4261-8037-131b911dfc86+13:2357:x1876505676321152:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 76us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575621.784865:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 310 00000100:00100000:3.0:1789575621.784876:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789575621.784901:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:3.0:1789575621.784910:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676321536:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575621.784920:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321664 00000100:00100000:0.0:1789575621.784925:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321664 00000100:00100000:3.0:1789575621.784963:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2357:x1876505676321536:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575621.784969:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321280 00000100:00100000:3.0:1789575621.784972:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:0.0:1789575621.784974:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321280 00000100:00100000:0.0:1789575621.785010:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:0.0:1789575621.785017:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676321664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575621.785047:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:2357:x1876505676321664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575621.785054:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:0.0:1789575621.785076:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:0.0:1789575621.785084:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2357:x1876505676321280:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575621.785119:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+18:2357:x1876505676321280:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575621.785137:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00080000:1.0:1789575621.789508:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789575621.789521:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789575621.789525:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575622.057018:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575622.066515:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699376256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575622.066607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575622.069581:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376256 00000100:00100000:0.0:1789575622.069605:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376256 00000100:00100000:0.0:1789575622.069717:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789575622.071904:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699376256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575622.071974:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575622.072069:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699376256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2340us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575622.072079:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789575622.072214:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575622.073082:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9686983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699376256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789575622.633612:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789575623.017631:0:11713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789575623.017641:0:11713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789575623.018297:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789575623.018304:0:11713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789575623.083447:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699376512:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.083524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575623.083577:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699377024:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.083604:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575623.083637:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789575623.083644:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699376384:0@lo:400:kworker.0 00000100:00100000:2.0:1789575623.084002:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699376640:0@lo:400:kworker.0 00000100:00100000:2.0:1789575623.084036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575623.084119:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575623.084307:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699376768:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.087487:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699376896:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.087552:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575623.087606:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376512 00000100:00100000:0.0:1789575623.087614:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376512 00000100:00100000:0.0:1789575623.087659:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376640 00000100:00100000:0.0:1789575623.087662:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376640 00000100:00100000:0.0:1789575623.087701:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376896 00000100:00100000:0.0:1789575623.087704:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376896 00000100:00100000:0.0:1789575623.087731:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789575623.087740:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699376512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.087802:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9686983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699376512:12345-0@lo:400:kworker.0 Request processed in 63us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575623.087809:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789575623.087839:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789575623.087847:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958682ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699376640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.087887:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958682ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699376640:12345-0@lo:400:kworker.0 Request processed in 41us (3850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575623.087893:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789575623.087904:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789575623.087910:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699376896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.087934:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699376896:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575623.087940:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789575623.087959:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376384 00000100:00100000:0.0:1789575623.087963:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376384 00000100:00100000:0.0:1789575623.087987:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789575623.087993:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699376384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.088025:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96888c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699376384:12345-0@lo:400:kworker.0 Request processed in 32us (4354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575623.088031:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1789575623.088512:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575623.088556:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699376384:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.088573:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699376896:0@lo:400:kworker.0 00000100:00100000:0.0:1789575623.088584:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699376512:0@lo:400:kworker.0 00000100:00100000:2.0:1789575623.089200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699376640:0@lo:400:kworker.0 00000100:00100000:3.0:1789575623.095248:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575623.095323:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377024 00000100:00100000:3.0:1789575623.095333:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377024 00000100:00100000:3.0:1789575623.095404:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699376768 00000100:00100000:3.0:1789575623.095408:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699376768 00000100:00100000:3.0:1789575623.095431:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789575623.095440:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699377024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575623.095509:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699377024:12345-0@lo:400:kworker.0 Request processed in 70us (11903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575623.095515:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789575623.095531:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789575623.095537:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699376768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575623.095569:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699376768:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575623.095575:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1789575623.095598:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575623.098396:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699377024:0@lo:400:kworker.0 00000100:00100000:3.0:1789575623.100810:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699376768:0@lo:400:kworker.0 00000100:00100000:1.0:1789575623.356529:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575623.361505:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676321792 00000100:00100000:0.0:1789575623.361524:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676321792 00000100:00100000:0.0:1789575623.361638:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:0.0:1789575623.361651:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+5:12303:x1876505676321792:12345-192.168.202.32@tcp:101:lsof.0 00010000:00010000:0.0:1789575623.361681:0:9231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789575623.361685:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789575623.361712:0:9231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5d96 expref: -99 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.361830:0:9231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.361848:0:9231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.361865:0:9231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575623.361913:0:9231:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575623.361917:0:9231:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575623.361969:0:9231:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9231 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.361999:0:9231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2157c00/0xc45cc82a223840fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d96 expref: 7 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.362024:0:9231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d96 expref: 6 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575623.362033:0:9231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:0.0:1789575623.362043:0:9231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575623.362049:0:9231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156400, rc 0) 00000100:00100000:0.0:1789575623.362150:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:12303:x1876505676321792:12345-192.168.202.32@tcp:101:lsof.0 Request processed in 501us (5632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575623.362158:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:1.0:1789575623.593470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575623.593499:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699377152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575623.593584:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575623.593974:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377152 00000100:00100000:2.0:1789575623.593985:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377152 00000100:00100000:2.0:1789575623.594068:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789575623.594079:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699377152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575623.594124:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575623.594196:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699377152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575623.594203:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789575623.594653:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699377152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575623.656735:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575624.680506:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575625.705568:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575625.789994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575625.808086:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676322048 00000100:00100000:2.0:1789575625.808109:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676322048 00000100:00100000:2.0:1789575625.808216:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:2.0:1789575625.808228:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+18:12304:x1876505676322048:12345-192.168.202.32@tcp:35:umount.0 00000100:00080000:0.0:1789575625.809933:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575625.810582:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+19:12304:x1876505676322048:12345-192.168.202.32@tcp:35:umount.0 Request processed in 2349us (20590us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789575625.810595:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:2.0:1789575625.829144:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575625.829410:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676322304 00000100:00100000:1.0:1789575625.829420:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676322304 00000100:00100000:1.0:1789575625.829488:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:1.0:1789575625.829497:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+19:12304:x1876505676322304:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:1.0:1789575625.829952:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+20:12304:x1876505676322304:12345-192.168.202.32@tcp:35:umount.0 Request processed in 454us (816us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789575625.829960:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:1.0:1789575625.834924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575625.835069:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676322560 00000100:00100000:3.0:1789575625.835083:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676322560 00000100:00100000:3.0:1789575625.835354:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789575625.835364:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690789450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+20:12304:x1876505676322560:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:3.0:1789575625.835673:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690789450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+21:12304:x1876505676322560:12345-192.168.202.32@tcp:35:umount.0 Request processed in 309us (762us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789575625.835680:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789575625.843043:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575625.843297:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676322816 00000100:00100000:2.0:1789575625.843310:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676322816 00000100:00100000:3.0:1789575625.843639:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:3.0:1789575625.843652:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+21:12304:x1876505676322816:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:3.0:1789575625.844070:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+22:12304:x1876505676322816:12345-192.168.202.32@tcp:35:umount.0 Request processed in 420us (1038us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789575625.844079:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789575625.850892:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575625.850994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575625.851322:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676322944 00000100:00100000:2.0:1789575625.851336:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676322944 00000100:00100000:2.0:1789575625.851431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676323072 00000100:00100000:2.0:1789575625.851435:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676323072 00000100:00100000:2.0:1789575625.851465:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789575625.851476:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969df01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+14:2355:x1876505676322944:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575625.851494:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575625.851515:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0600/0xc45cc82a22383189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5928 expref: 14 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575625.851544:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575625.851619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575625.851632:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+13:2355:x1876505676323072:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575625.851642:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575625.851651:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031c00/0xc45cc82a223830ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae58f0 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.851660:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575625.851764:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969df01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+12:2355:x1876505676322944:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 288us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575625.852706:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+12:2355:x1876505676323072:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1066us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575625.852816:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575625.852893:0:8471:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789575625.852903:0:8471:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1789575625.853062:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676323200 00000100:00100000:3.0:1789575625.853069:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676323200 00000100:00100000:2.0:1789575625.855023:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789575625.855306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575625.855806:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789575625.855823:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+11:2356:x1876505676323200:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789575625.855848:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575625.855878:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2157200/0xc45cc82a22383373 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59f3 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.855894:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575625.855972:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676323200:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 157us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575625.856000:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575625.857181:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575625.857224:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676323584 00000100:00100000:2.0:1789575625.857235:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676323584 00000100:00100000:2.0:1789575625.857305:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:2.0:1789575625.857314:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+7:2354:x1876505676323584:12345-192.168.202.32@tcp:9:umount.0 00000020:00000080:2.0:1789575625.857346:0:6709:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223836c9 00000020:00010000:2.0:1789575625.857354:0:6709:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e96c1275000: total 0 00000100:00080000:2.0:1789575625.857359:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8e96c1275800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789575625.857416:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789575625.857785:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2354:x1876505676323584:12345-192.168.202.32@tcp:9:umount.0 Request processed in 470us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575625.857794:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00080000:3.0:1789575625.858047:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1789575625.860670:0:8472:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e96c1275000: total 0 00010000:00010000:1.0:1789575625.860760:0:8472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e96c1275000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789575625.860836:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223840f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d8f expref: 4 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575625.860880:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea122c4e/0xc45cc82a22383a65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc8 expref: 3 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575625.860897:0:8472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e96c1275000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789575625.860908:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575625.860911:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575625.860913:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575625.864008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575625.864870:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676323712 00000100:00100000:3.0:1789575625.864883:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676323712 00000100:00080000:0.0:1789575625.864942:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575625.864964:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:0.0:1789575625.868091:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+5:2354:x1876505676323712:12345-192.168.202.32@tcp:9:umount.0 00000020:00000080:0.0:1789575625.868144:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22383461 00000100:00080000:0.0:1789575625.868158:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e96878e7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789575625.868243:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789575625.868571:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22a2b54c-4bca-4302-892e-490c3310b8b3+2:2354:x1876505676323712:12345-192.168.202.32@tcp:9:umount.0 Request processed in 3594us (4573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575625.868594:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00010000:00010000:1.0:1789575625.869856:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575625.892988:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575625.893107:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676324736 00000100:00100000:0.0:1789575625.893120:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676324736 00000100:00100000:0.0:1789575625.893188:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 239 00000100:00100000:0.0:1789575625.893199:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+22:2354:x1876505676324736:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:0.0:1789575625.893240:0:5863:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223830fd 00000020:00010000:0.0:1789575625.893261:0:5863:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e96bc3cf000: total 0 00000100:00080000:0.0:1789575625.893267:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8e96bc3cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789575625.893761:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789575625.894141:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22a2b54c-4bca-4302-892e-490c3310b8b3+21:2354:x1876505676324736:12345-192.168.202.32@tcp:39:umount.0 Request processed in 940us (1161us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789575625.894152:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 239 00000020:00010000:1.0:1789575625.895103:0:5850:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e96bc3cf000: total 0 00010000:00010000:0.0:1789575625.895246:0:5850:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e96bc3cf000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789575625.895284:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575625.895289:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789575625.895300:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1200/0xc45cc82a22383ad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5be4 expref: 20 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895344:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575625.895346:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575625.895351:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22383a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bb3 expref: 19 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895363:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575625.895365:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789575625.895389:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22383a50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bc1 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895406:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575625.895409:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575625.895413:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077e00/0xc45cc82a22383fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d42 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895705:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:0.0:1789575625.895709:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575625.895714:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f0a00/0xc45cc82a22383ab9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5bdd expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895728:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575625.895730:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789575625.895734:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077c00/0xc45cc82a22383724 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5aef expref: 15 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895746:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9683773600) 00010000:00010000:0.0:1789575625.895748:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575625.895760:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a223833c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a01 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895781:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e9687bd8800) 00010000:00010000:0.0:1789575625.895783:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789575625.895786:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9680030a00/0xc45cc82a22383946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5b7b expref: 13 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895801:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575625.895803:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789575625.895807:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0600/0xc45cc82a223840b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d7a expref: 12 pid: 7184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895820:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e9683773b00) 00010000:00010000:0.0:1789575625.895822:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789575625.895826:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22383437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a1d expref: 11 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895840:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575625.895842:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789575625.895847:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96813d0400/0xc45cc82a223840e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d88 expref: 10 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895863:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9683773f00) 00010000:00010000:0.0:1789575625.895866:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575625.895870:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8000/0xc45cc82a223833e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5a08 expref: 9 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895884:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e9687bd8400) 00010000:00010000:0.0:1789575625.895891:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789575625.895897:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e95850f1000/0xc45cc82a22383db4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5cb6 expref: 8 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575625.895911:0:5850:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e96bc3cf000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789575625.895928:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575625.895930:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575625.895932:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575626.728683:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575626.892881:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575626.893092:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676324992 00000100:00100000:1.0:1789575626.893104:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676324992 00000100:00100000:1.0:1789575626.893179:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:1.0:1789575626.893191:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2357:x1876505676324992:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575626.893276:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2357:x1876505676324992:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00080000:0.0:1789575626.894239:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575626.894404:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:2.0:1789575626.898170:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575626.898271:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676324864 00000100:00100000:0.0:1789575626.898353:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676324864 00000100:00100000:0.0:1789575626.898556:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 312 00000100:00100000:0.0:1789575626.898570:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676324864:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575626.898813:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+10:2357:x1876505676324864:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 245us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575626.898822:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 312 00000100:00100000:2.0:1789575627.176883:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575627.176919:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699377280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575627.177004:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575627.177195:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377280 00000100:00100000:3.0:1789575627.177205:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377280 00000100:00100000:3.0:1789575627.177278:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789575627.177297:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699377280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575627.177356:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575627.177437:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699377280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575627.177443:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789575627.177543:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575627.177617:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699377280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575627.752765:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575628.200686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699377792:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.200762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575628.200829:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575628.200837:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699377664:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.200865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575628.201022:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699377536:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575628.201084:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699378048:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201104:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575628.201121:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789575628.201127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699377408:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201163:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575628.201188:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699377920:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201208:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575628.201255:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377664 00000100:00100000:0.0:1789575628.201264:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377664 00000100:00100000:0.0:1789575628.201316:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377536 00000100:00100000:0.0:1789575628.201320:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377536 00000100:00100000:0.0:1789575628.201349:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377920 00000100:00100000:0.0:1789575628.201353:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377920 00000100:00100000:0.0:1789575628.201398:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789575628.201408:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699377664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201455:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699377664:12345-0@lo:400:kworker.0 Request processed in 50us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.201462:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789575628.201479:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789575628.201484:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699377536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201514:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699377536:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.201520:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789575628.201529:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789575628.201535:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699377920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201571:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876505699377920:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.201576:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789575628.201594:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377408 00000100:00100000:0.0:1789575628.201597:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377408 00000100:00100000:0.0:1789575628.201617:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789575628.201623:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699377408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201650:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699377408:12345-0@lo:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.201666:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:0.0:1789575628.201727:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575628.201751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699377408:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201763:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699377920:0@lo:400:kworker.0 00000100:00100000:0.0:1789575628.201771:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699377536:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.202117:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699377792 00000100:00100000:3.0:1789575628.202121:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699377792 00000100:00100000:3.0:1789575628.202164:0:9232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378048 00000100:00100000:3.0:1789575628.202169:0:9232:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378048 00000100:00100000:3.0:1789575628.202198:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789575628.202205:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699377792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.202242:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699377792:12345-0@lo:400:kworker.0 Request processed in 38us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575628.202248:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789575628.202260:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789575628.202266:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699378048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.202297:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699378048:12345-0@lo:400:kworker.0 Request processed in 31us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575628.202302:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1789575628.202326:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575628.202357:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbcaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699377664:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.202404:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699377792:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.202428:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bb5b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699378048:0@lo:400:kworker.0 00000100:00100000:3.0:1789575628.582048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575628.582094:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575628.582121:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575628.582186:0:12805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676325120 00000100:00100000:1.0:1789575628.582196:0:12805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676325120 00000100:00100000:2.0:1789575628.582201:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676325376 00000100:00100000:2.0:1789575628.582208:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676325376 00000100:00100000:2.0:1789575628.582295:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676325248 00000100:00100000:2.0:1789575628.582299:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676325248 00000100:00100000:0.0:1789575628.582426:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789575628.582438:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+12:2356:x1876505676325376:12345-192.168.202.32@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789575628.582442:0:12805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789575628.582456:0:12805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9131551-6e4d-4261-8037-131b911dfc86+12:2356:x1876505676325120:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575628.582470:0:12805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575628.582470:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575628.582495:0:12805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1c00/0xc45cc82a223831cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae593d expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575628.582496:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9687ef9200/0xc45cc82a2238336c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae59ec expref: 12 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575628.582529:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575628.582530:0:12805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575628.582593:0:12805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9131551-6e4d-4261-8037-131b911dfc86+10:2356:x1876505676325120:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 142us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575628.582601:0:12805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789575628.587820:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789575628.587849:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+9:2356:x1876505676325248:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575628.587871:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575628.587895:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680030200/0xc45cc82a223831d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5967 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575628.587919:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789575628.592776:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb5b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9131551-6e4d-4261-8037-131b911dfc86+8:2356:x1876505676325376:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 10327us (10665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.592794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789575628.600825:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcd90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9131551-6e4d-4261-8037-131b911dfc86+7:2356:x1876505676325248:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 12976us (18686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575628.600842:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789575628.608833:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575628.609409:0:9231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676325632 00000100:00100000:1.0:1789575628.609421:0:9231:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676325632 00000100:00080000:3.0:1789575628.609474:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575628.609505:0:9231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:1.0:1789575628.609514:0:9231:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+6:2354:x1876505676325632:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:1.0:1789575628.610038:0:9231:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223831e4 00000020:00010000:1.0:1789575628.610048:0:9231:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e9690b9a000: total 0 00000100:00080000:1.0:1789575628.610054:0:9231:0:(import.c:65:import_set_state_nolock()) ffff8e9690b9b000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1789575628.610169:0:5850:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e9690b9a000: total 0 00010000:00010000:0.0:1789575628.610174:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575628.610214:0:5850:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9690b9a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789575628.610248:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687bd8a00) 00010000:00010000:0.0:1789575628.610252:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575628.610261:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2156400/0xc45cc82a22384103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5d96 expref: 5 pid: 9231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575628.610287:0:5850:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9690b9a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789575628.610308:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575628.610322:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575628.610323:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789575628.610788:0:9231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789575628.611212:0:9231:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1+3:2354:x1876505676325632:12345-192.168.202.32@tcp:39:umount.0 Request processed in 1695us (2385us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789575628.611223:0:9231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:3.0:1789575628.677349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575628.678612:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676325888 00000100:00100000:0.0:1789575628.678628:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676325888 00000100:00100000:0.0:1789575628.678709:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 314 00000100:00100000:0.0:1789575628.678721:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+7:2354:x1876505676325888:12345-192.168.202.32@tcp:251:umount.0 00000020:00000080:0.0:1789575628.678772:0:5854:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223830da 00000020:00010000:0.0:1789575628.678781:0:5854:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e96bc3ca000: total 0 00000100:00080000:0.0:1789575628.678786:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8e96bc3cc000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789575628.678882:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9690afec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9131551-6e4d-4261-8037-131b911dfc86+3:2354:x1876505676325888:12345-192.168.202.32@tcp:251:umount.0 Request processed in 163us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575628.678890:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 314 00000020:00010000:1.0:1789575628.679072:0:8472:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e96bc3ca000: total 0 00010000:00010000:1.0:1789575628.679148:0:8472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e96bc3ca000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789575628.679183:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1800/0xc45cc82a22383190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae592f expref: 2 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575628.679199:0:8472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e96bc3ca000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789575628.679208:0:8472:0:(genops.c:885:class_export_put()) final put ffff8e96bc3ca000/f9131551-6e4d-4261-8037-131b911dfc86 00010000:00010000:1.0:1789575628.679230:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575628.679232:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575628.679234:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789575628.680817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc3ca000/f9131551-6e4d-4261-8037-131b911dfc86 for MGS 00000020:00000080:0.0:1789575628.680857:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bc3cc000 for MGS 00000100:00100000:3.0:1789575628.714390:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699378176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575628.714492:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575628.714718:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378176 00000100:00100000:2.0:1789575628.714728:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378176 00000100:00100000:2.0:1789575628.714796:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789575628.714808:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699378176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575628.714846:0:6711:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575628.714895:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699378176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575628.714903:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789575628.715085:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699378176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789575628.776945:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789575628.859744:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:2.0:1789575628.859757:0:6734:0:(genops.c:885:class_export_put()) final put ffff8e96878e0000/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:3.0:1789575628.860313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96878e0000/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-OST0000 00000020:00000080:3.0:1789575628.860421:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96878e7800 for lustre-OST0000 00010000:00010000:0.0:1789575629.804801:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789575629.805502:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000001:00080000:0.0:1789575629.805516:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:0.0:1789575629.805524:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000001:00080000:0.0:1789575629.805531:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789575629.805535:0:5884:0:(genops.c:885:class_export_put()) final put ffff8e9690b9a000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 00000020:00000080:0.0:1789575629.806357:0:5884:0:(genops.c:885:class_export_put()) final put ffff8e96bc3cf000/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:3.0:1789575629.806469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9690b9a000/b02ddbb6-5a7f-49fa-b3d2-8cd265c33dc1 for lustre-MDT0000 00000020:00000080:3.0:1789575629.814808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc3cf000/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-MDT0000 00000020:00000080:3.0:1789575629.814902:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9690b9b000 for lustre-MDT0000 00000020:00000080:3.0:1789575629.814908:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bc3cd800 for lustre-MDT0000 00000001:00100000:1.0:1789575630.323904:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:1.0:1789575630.323918:0:7664:0:(genops.c:885:class_export_put()) final put ffff8e96c1275000/22a2b54c-4bca-4302-892e-490c3310b8b3 00000020:00000080:0.0:1789575630.324014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96c1275000/22a2b54c-4bca-4302-892e-490c3310b8b3 for lustre-OST0001 00000020:00000080:0.0:1789575630.324081:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96c1275800 for lustre-OST0001 00010000:00010000:2.0:1789575630.826758:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789575631.100223:0:12896:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789575631.149274:0:12896:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789575631.149348:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149386:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149395:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149404:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149427:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789575631.149434:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789575631.149466:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575631.149473:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149520:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031e00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575631.149525:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149535:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575631.149544:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575631.149550:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789575631.149554:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789575631.149567:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789575631.149622:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149630:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575631.149679:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149688:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680031e00/0xc45cc82a2238315f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383166 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575631.149702:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575631.149704:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575631.149706:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789575631.149723:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789575631.149728:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789575631.149737:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789575631.149762:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e9682b8e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789575631.150226:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699378432:0@lo:39:umount.0 00000100:00100000:0.0:1789575631.150321:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575631.151020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575631.151040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699378304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789575631.151088:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575631.151539:0:7184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378432 00000100:00100000:1.0:1789575631.151551:0:7184:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378432 00000100:00100000:1.0:1789575631.151850:0:7184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789575631.151863:0:7184:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876505699378432:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789575631.151905:0:7184:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382ef7 00000100:00080000:1.0:1789575631.151917:0:7184:0:(import.c:65:import_set_state_nolock()) ffff8e9683db6800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789575631.152013:0:7184:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876505699378432:12345-0@lo:39:umount.0 Request processed in 153us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575631.152021:0:7184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789575631.152035:0:7184:0:(genops.c:885:class_export_put()) final put ffff8e9683db7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789575631.152257:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9683db7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789575631.152325:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9683db6800 for lustre-MDT0000 00000100:00100000:0.0:1789575631.152410:0:12805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378304 00000100:00100000:0.0:1789575631.152417:0:12805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378304 00000100:00100000:3.0:1789575631.152730:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789575631.152743:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+19:3306:x1876505699378304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575631.152772:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575631.152966:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575631.153018:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9682b8e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789575631.153039:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699378432:0@lo:39:umount.0 00010000:00010000:3.0:1789575631.153659:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1400/0xc45cc82a22383166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a2238315f expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.153685:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575631.153778:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+18:3306:x1876505699378304:12345-0@lo:103:ldlm_bl.0 Request processed in 1038us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575631.153788:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789575631.154272:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699378304:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789575631.154409:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789575631.154416:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789575631.154422:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789575631.162303:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162331:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162340:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162349:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162407:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575631.162415:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162422:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162429:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162460:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162479:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789575631.162487:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162505:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162512:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162518:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162530:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789575631.162537:0:12896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162544:0:12896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162550:0:12896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162555:0:12896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.162583:0:12896:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789575631.162588:0:12896:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789575631.162624:0:12896:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789575631.162629:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789575631.162635:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789575631.162642:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789575631.162662:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e95850a6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789575631.162669:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e9585248800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789575631.162674:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e96879bcd40) has exports, disconnecting them 00000020:00080000:3.0:1789575631.162679:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e95850a6000), last request at 1789575628 00000020:00000080:3.0:1789575631.162688:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a2238305c 00000100:00080000:3.0:1789575631.162712:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e95850a3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789575631.162771:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e95850a6000): rc 0 00000020:00000080:3.0:1789575631.162773:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e95850a6000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1789575631.165704:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789575631.165725:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165740:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0000 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575631.165746:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165758:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575631.165767:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575631.165773:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789575631.165775:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789575631.165780:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789575631.165859:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165867:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575631.165904:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165911:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0000/0xc45cc82a2238316d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22383174 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165954:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789575631.165958:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165964:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575631.165968:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.165975:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575631.165982:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575631.165986:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789575631.165989:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789575631.165991:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789575631.166004:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166010:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575631.166016:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166022:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f1600/0xc45cc82a22383094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238309b expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166035:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789575631.166039:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166051:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f1c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575631.166054:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166061:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575631.166067:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575631.166072:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789575631.166074:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789575631.166076:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789575631.166088:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166093:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575631.166110:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166117:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f1c00/0xc45cc82a22383396 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238339d expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166140:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575631.166144:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166149:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156800 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:0.0:1789575631.166152:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166167:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789575631.166173:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575631.166179:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789575631.166182:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789575631.166183:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789575631.166200:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166206:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789575631.166213:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166218:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22382e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a22382e4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.166232:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575631.166234:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575631.166236:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575631.166262:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699378688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789575631.166360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575631.166994:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575631.167012:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699378560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575631.167052:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789575631.167245:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e9585248800), last request at 1789575628 00000020:00000080:3.0:1789575631.167256:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382f91 00000100:00080000:3.0:1789575631.167270:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e958524c800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789575631.167298:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9585248800): rc 0 00000020:00000080:3.0:1789575631.167300:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9585248800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789575631.167319:0:12896:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6d383bb3ae0 00000100:00080000:3.0:1789575631.167347:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789575631.167352:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789575631.167367:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789575631.167453:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789575631.167473:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e9584e4b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789575631.167489:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789575631.167501:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789575631.167523:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789575631.167615:0:12896:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789575631.167626:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e96bc350000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789575631.167679:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e96879bcd40) has no exports 00000020:00000080:1.0:1789575631.168485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e95850a6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789575631.168585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9585248800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789575631.168616:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e95850a3000 for lustre-MDT0000 00000020:00000080:1.0:1789575631.168622:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e958524c800 for lustre-MDT0000 00000100:00100000:0.0:1789575631.169285:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699378944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575631.169484:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575631.169910:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699378816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789575631.169956:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699379072:0@lo:9:umount.0 00000100:00100000:0.0:1789575631.170010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575631.170048:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699379200:0@lo:9:umount.0 00000100:00100000:0.0:1789575631.170074:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575631.170131:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699379072 00000100:00100000:0.0:1789575631.170143:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699379072 00000100:00100000:0.0:1789575631.170213:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699379200 00000100:00100000:0.0:1789575631.170216:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699379200 00000100:00100000:0.0:1789575631.170243:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789575631.170253:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876505699379072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789575631.170291:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382fde 00000100:00080000:0.0:1789575631.170302:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8e9584e42800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789575631.170343:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789575631.170740:0:9232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789575631.170752:0:9232:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876505699379200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789575631.170770:0:9232:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223830c5 00000100:00080000:3.0:1789575631.170779:0:9232:0:(import.c:65:import_set_state_nolock()) ffff8e958524b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789575631.170825:0:9232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789575631.171230:0:9232:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876505699379200:12345-0@lo:9:umount.0 Request processed in 479us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575631.171239:0:9232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1789575631.171292:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575631.172262:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3305:x1876505699379072:12345-0@lo:9:umount.0 Request processed in 2005us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575631.172275:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789575631.172305:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575631.172311:0:5858:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789575631.172325:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575631.172397:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9584e4b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789575631.172418:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789575631.172421:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789575631.172426:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699379072:0@lo:9:umount.0 00000100:00080000:0.0:1789575631.172441:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e96bc350000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789575631.172453:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789575631.172454:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789575631.172457:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699379200:0@lo:9:umount.0 00010000:00010000:0.0:1789575631.172507:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575631.173735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378688 00000100:00100000:3.0:1789575631.173751:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378688 00000100:00100000:3.0:1789575631.173838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378560 00000100:00100000:3.0:1789575631.173843:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378560 00000100:00100000:3.0:1789575631.173870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575631.173879:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969df00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+19:3309:x1876505699378688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575631.173902:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575631.173928:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1800/0xc45cc82a2238309b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383094 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.173951:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575631.174022:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969df00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+18:3309:x1876505699378688:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (7663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575631.174030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789575631.174091:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789575631.174097:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+17:3308:x1876505699378560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575631.174138:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575631.174148:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9687ef9c00/0xc45cc82a22383174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a2238316d expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.174158:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575631.174189:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30b00971-c2a0-490d-912f-6313f32cd11c+16:3308:x1876505699378560:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (7136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575631.174195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789575631.174617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575631.174727:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:30b00971-c2a0-490d-912f-6313f32cd11c:3309:1876505699378688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575631.175008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575631.175053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378816 00000100:00100000:2.0:1789575631.175059:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378816 00000100:00100000:2.0:1789575631.175098:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699378944 00000100:00100000:2.0:1789575631.175101:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699378944 00000100:00100000:2.0:1789575631.175114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789575631.175242:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789575631.175251:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+17:3307:x1876505699378944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575631.175264:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575631.175278:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076600/0xc45cc82a22382e4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22382e48 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575631.175296:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575631.175340:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b00971-c2a0-490d-912f-6313f32cd11c+16:3307:x1876505699378944:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575631.175347:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789575631.175427:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699378560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575631.175488:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+17:3306:x1876505699378816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575631.175625:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575631.175638:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1000/0xc45cc82a2238339d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383396 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575631.175659:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575631.175810:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b00971-c2a0-490d-912f-6313f32cd11c+14:3306:x1876505699378816:12345-0@lo:103:ldlm_bl.0 Request processed in 689us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575631.175819:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789575631.175847:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:30b00971-c2a0-490d-912f-6313f32cd11c:3307:1876505699378944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789575631.176071:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699378816:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789575631.190138:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e96879bcd40) has no exports 00000020:00000080:3.0:1789575631.286475:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382ea3 00000020:00000080:3.0:1789575631.286583:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bd33d800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789575631.286695:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789575631.286843:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd33d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789575631.286927:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575631.286941:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789575631.286947:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e96919a8000) has no exports 00000020:00000080:2.0:1789575631.287629:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e9c 00000020:00000080:2.0:1789575631.287638:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9682b8a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789575631.287706:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9682b8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789575631.287783:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575631.287792:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789575631.287795:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9682b8a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789575631.287798:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9682b8a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789575631.287821:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789575631.287986:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e96908ef0c0 - data ffff8e96c1ee4870/ffff8e96bbe6e800 00000020:01000000:2.0:1789575631.288155:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e9699c69f60 - data ffff8e969c3e2ca8/ffff8e9687f9ec00 00000001:00000004:0.0:1789575631.309886:0:12896:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1789575631.415262:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789575631.415275:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789575631.415312:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789575631.415315:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789575631.416204:0:6803:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789575631.416214:0:6803:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789575631.416228:0:6803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789575631.418310:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789575631.418321:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789575631.418341:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789575631.418345:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789575631.419398:0:7869:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789575631.419409:0:7869:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789575631.419421:0:7869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789575631.536686:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e6b 00000020:00000080:1.0:1789575631.536756:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bb287800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789575631.537655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bb287800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789575631.540318:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e80 00000020:00000080:1.0:1789575631.540336:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bd33a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789575631.540365:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789575631.540688:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.540702:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789575631.540708:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e96879bb380) has no exports 00000004:01000000:1.0:1789575631.540946:0:12896:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789575631.540960:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223830be 00000020:00000080:1.0:1789575631.540977:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9584720000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789575631.540982:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789575631.540987:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.540995:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789575631.540998:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e96bbee19c0) has no exports 00000020:00000080:1.0:1789575631.541006:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a223830b7 00000020:00000080:1.0:1789575631.541010:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bc354800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789575631.541113:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd33a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789575631.541123:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584720000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789575631.541199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc354800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789575631.541914:0:12896:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789575631.541920:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789575631.541926:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789575631.541932:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789575631.541935:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789575631.542173:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.542186:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789575631.542194:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382fd7 00000020:00000080:1.0:1789575631.542202:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e95850a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789575631.542314:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e96bc350000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789575631.542323:0:36:0:(genops.c:885:class_export_put()) final put ffff8e96bc350800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789575631.542326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc350800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789575631.542333:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789575631.542666:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789575631.542675:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.542686:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789575631.542690:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e9585104d40) has no exports 00000020:00000080:1.0:1789575631.542699:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382fd0 00000020:00000080:1.0:1789575631.542704:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9584e4b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789575631.542724:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e95850a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789575631.543405:0:12896:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789575631.543411:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789575631.543416:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789575631.543422:0:12896:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789575631.543425:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789575631.543678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584e4b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789575631.543797:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.543807:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789575631.543851:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.543872:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789575631.543877:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bb281800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789575631.543880:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bb281800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789575631.543886:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789575631.544095:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9584e4b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789575631.544105:0:36:0:(genops.c:885:class_export_put()) final put ffff8e958524f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789575631.544108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e958524f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789575631.544112:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789575631.544418:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e87 00000020:00000080:1.0:1789575631.544429:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bd33f800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789575631.544450:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789575631.544457:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.544463:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789575631.544467:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e96879b8000) has no exports 00000020:00000080:1.0:1789575631.544621:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.544626:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789575631.544630:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e8e 00000020:00000080:1.0:1789575631.544635:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bd33b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789575631.544655:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9689726000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789575631.544660:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9689726000 3 00000020:01000004:1.0:1789575631.544663:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e9689726000 from lustre-MDT0000 00000020:00000080:1.0:1789575631.544688:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.544691:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789575631.544695:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96bb283000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789575631.544697:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bb283000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789575631.544704:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789575631.544732:0:12896:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789575631.544736:0:12896:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789575631.544740:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789575631.544743:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.544746:0:12896:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789575631.544753:0:12896:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e968798b800 30b00971-c2a0-490d-912f-6313f32cd11c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789575631.544759:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e9690bab380) has exports, disconnecting them 00000020:00080000:1.0:1789575631.544764:0:12896:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e968798b800), last request at 1789575370 00000020:00000080:1.0:1789575631.544780:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e2c 00000020:00010000:1.0:1789575631.544784:0:12896:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e968798b800: total 2 00000100:00080000:1.0:1789575631.544801:0:12896:0:(import.c:65:import_set_state_nolock()) ffff8e968798b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789575631.544825:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e968798b800): rc 0 00000020:00080000:1.0:1789575631.544831:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e9690bab380) has no exports 00000100:00100000:1.0:1789575631.545449:0:5854:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e968975aa00:5854] 0 exiting: rc = 1 00000020:00000080:0.0:1789575631.545716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd33f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789575631.545723:0:36:0:(genops.c:885:class_export_put()) final put ffff8e96bd33c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789575631.545725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd33c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789575631.545730:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789575631.545946:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bd33b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1789575631.546212:0:5856:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e968975b200:5856] 1 exiting: rc = 0 00000020:00010000:0.0:1789575631.546474:0:8472:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e968798b800: total 0 00010000:00010000:0.0:1789575631.546673:0:8472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e968798b800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789575631.546718:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1200/0xc45cc82a22382f44 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22382f3d expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546744:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0000/0xc45cc82a22383182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a2238317b expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546759:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2156000/0xc45cc82a22383381 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a2238337a expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546772:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f0800/0xc45cc82a2238338f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383388 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546787:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9687ef8e00/0xc45cc82a2238312e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383127 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546800:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a22383158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383151 expref: 4 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546810:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e95850f1e00/0xc45cc82a2238313c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383135 expref: 3 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546820:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9680031800/0xc45cc82a2238314a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc45cc82a22383143 expref: 2 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575631.546831:0:8472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e968798b800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789575631.546844:0:8472:0:(genops.c:885:class_export_put()) final put ffff8e968798b800/30b00971-c2a0-490d-912f-6313f32cd11c 00010000:00010000:0.0:1789575631.546908:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575631.546911:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575631.546913:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789575631.546943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e968798b800/30b00971-c2a0-490d-912f-6313f32cd11c for MGS 00000100:00100000:3.0:1789575631.547034:0:5857:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e9687983600:5857] 2 exiting: rc = 0 00000100:00100000:0.0:1789575631.547143:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547168:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547175:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547183:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547189:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547197:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547204:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547211:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547216:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547223:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547230:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547237:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547243:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547249:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547256:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547262:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547269:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547278:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547284:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547291:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547297:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547305:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547311:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547318:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547325:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547332:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547339:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547346:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547353:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547359:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547365:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547389:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547395:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547402:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547408:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547415:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547427:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547433:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547438:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547445:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547451:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547458:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547463:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547469:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547475:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547481:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547487:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547933:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547941:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547948:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547955:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547973:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547981:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547987:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.547994:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548000:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548012:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548019:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548036:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548045:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548051:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548058:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.548063:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789575631.548836:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789575631.548841:0:12896:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1789575631.552046:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e968798b000 for MGS 00000020:01000000:1.0:1789575631.554752:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e96908ef720 - data ffff8e96c1ee4000/ffff8e96bbe6dc00 00000020:01000000:1.0:1789575631.554913:0:12896:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e9699e9f480 - data ffff8e96890bf510/ffff8e96b0ecf400 00000020:00000080:1.0:1789575631.557228:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e10 00000020:00000080:1.0:1789575631.557243:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e968885e000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789575631.557274:0:12896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9689726000 from MGS, refs=2 00000020:01000004:1.0:1789575631.557279:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9689726000 2 00000020:01000004:1.0:1789575631.557283:0:12896:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e9689726000 from MGS 00000020:00000080:2.0:1789575631.557309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e968885e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789575631.557318:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575631.557329:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789575631.557332:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9699d6c800/MGS 00000020:00000080:1.0:1789575631.557334:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9699d6c800/MGS for MGS 00000020:01000000:1.0:1789575631.557342:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789575631.557451:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789575631.557457:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789575631.557464:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789575631.557473:0:12896:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e96aa298000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789575631.557480:0:12896:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e96919a99c0) has exports, disconnecting them 00000020:00080000:1.0:1789575631.557486:0:12896:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e96aa298000), last request at 1789575372 00000020:00000080:1.0:1789575631.557747:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382edb 00000020:00080000:1.0:1789575631.557761:0:12896:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e96aa298000): rc 0 00000020:00000080:1.0:1789575631.557766:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e96aa298000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789575631.559434:0:12896:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789575631.559444:0:12896:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789575631.559450:0:12896:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789575631.559459:0:12896:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789575631.559682:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96aa298000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789575631.562404:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9682b8e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789575631.569334:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789575631.569400:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789575631.569408:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9682b8f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789575631.569413:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9682b8f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789575631.569428:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789575631.569878:0:12896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9689726000 1 00000020:00000080:0.0:1789575631.569887:0:12896:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e02 00000020:00000080:0.0:1789575631.569896:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9699d6a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789575631.569918:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789575631.569925:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789575631.569930:0:12896:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789575631.569934:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e96919acd40) has no exports 00000020:00000080:2.0:1789575631.569997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9699d6a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789575631.689898:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575631.689922:0:12896:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789575631.689929:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e968885e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789575631.689935:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e968885e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789575631.689946:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789575631.690156:0:12896:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e9689721800 00000020:01000000:2.0:1789575631.690186:0:12896:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789575631.690192:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575631.690198:0:12896:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789575631.690204:0:12896:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e9690bacd40) has no exports 00000100:00100000:2.0:1789575631.690319:0:9231:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8e9699eb1a00:9231] 4 exiting: rc = 0 00000100:00100000:0.0:1789575631.690896:0:5862:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e969aeeba00:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1789575631.693263:0:7184:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e96bc54b400:7184] 3 exiting: rc = 0 00000100:00100000:3.0:1789575631.696953:0:5864:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e969aeea000:5864] 2 exiting: rc = 0 00000100:00100000:3.0:1789575631.697122:0:5863:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e9686622000:5863] 1 exiting: rc = 0 00000100:00100000:2.0:1789575631.697264:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697275:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697281:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697297:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697303:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697310:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697317:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697323:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697330:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697337:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697344:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697349:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697356:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697362:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697368:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697625:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697630:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697635:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697651:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697658:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697664:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697670:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697676:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697681:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697687:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697693:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697699:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697706:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697712:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697718:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697725:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697730:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697736:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697743:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697749:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697755:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697761:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697766:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697783:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697789:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697796:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697803:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697808:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697815:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697821:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697827:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697833:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697840:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697845:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697852:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697858:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697864:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697870:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697876:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697900:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697907:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697913:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697920:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697927:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697933:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697939:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697945:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697952:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.697959:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.708457:0:5865:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e9686622800:5865] 0 exiting: rc = 1 00000100:00100000:0.0:1789575631.708590:0:5866:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e9686622600:5866] 1 exiting: rc = 0 00000100:00100000:2.0:1789575631.710702:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710715:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710723:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710730:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710736:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710743:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710753:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710760:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710767:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710798:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710812:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710821:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710826:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710833:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710839:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710844:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710849:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710855:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710861:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710866:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710871:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710876:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710882:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710887:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710892:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710899:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710905:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710910:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710915:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710922:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710927:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710933:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710938:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710944:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710949:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710955:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710961:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710966:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710985:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710991:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.710996:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711001:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711019:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711101:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711107:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711113:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711118:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711123:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711129:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711136:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711141:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711148:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711154:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711161:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711169:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711175:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711182:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711189:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711195:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711201:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711207:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.711213:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.713659:0:5867:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e96862d3800:5867] 0 exiting: rc = 1 00000100:00100000:2.0:1789575631.714493:0:5868:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e9687992e00:5868] 1 exiting: rc = 0 00000100:00100000:0.0:1789575631.715457:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715468:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715478:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715486:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715493:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715500:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715507:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715534:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715543:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715551:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715557:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715565:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715572:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715579:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715586:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715593:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715600:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715607:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715634:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715666:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715674:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715681:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715688:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715696:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715703:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715711:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715718:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715725:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715731:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715740:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715747:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715768:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715775:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715783:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715792:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715799:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715805:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715812:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715819:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715825:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715838:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715859:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715872:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715914:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715958:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715967:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715985:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715992:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.715998:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716006:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716013:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716019:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716025:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716047:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716075:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716083:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716090:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716097:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716103:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716109:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716115:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716122:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.716134:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.738892:0:5869:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e9687992400:5869] 0 exiting: rc = 1 00000100:00100000:0.0:1789575631.739048:0:5870:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e968b2f7800:5870] 1 exiting: rc = 0 00000100:00100000:0.0:1789575631.739123:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739131:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739138:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739144:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739151:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739158:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739164:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739169:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739175:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739181:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739187:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739192:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739199:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739205:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739211:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739216:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739222:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739228:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739235:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739240:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739423:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739432:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739438:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739465:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739470:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739476:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739482:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739488:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739494:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739500:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739506:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739512:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739518:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739524:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739530:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739535:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739541:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739547:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739553:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739558:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739564:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739570:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739576:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739581:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739587:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739592:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739597:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739603:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739607:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739612:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739618:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739624:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739629:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739634:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739639:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739656:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739662:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739667:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739681:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739686:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739692:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739697:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739701:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.739707:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.747907:0:5871:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e9687957400:5871] 0 exiting: rc = 1 00000100:00100000:0.0:1789575631.752033:0:5872:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e9687981400:5872] 1 exiting: rc = 0 00000100:00100000:0.0:1789575631.752402:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752411:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752417:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752423:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752429:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752435:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752442:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752447:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752452:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752458:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752463:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752469:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752474:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752480:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752486:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752491:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752497:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752502:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752508:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752513:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752518:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752523:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752529:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752534:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752538:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752544:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752550:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752556:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752579:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752584:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752590:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752596:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752602:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752607:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752614:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752621:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752626:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752632:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752638:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752654:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752660:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752666:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752671:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752677:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752684:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752689:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752695:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752701:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752707:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752713:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752719:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752725:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752731:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752736:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752741:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752747:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752752:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752757:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752762:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752768:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752774:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752780:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752785:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575631.752800:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.761262:0:5874:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e9687980000:5874] 1 exiting: rc = 0 00000100:00100000:3.0:1789575631.762233:0:5873:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e9687981a00:5873] 0 exiting: rc = 1 00000100:00100000:2.0:1789575631.762631:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.762650:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.762657:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.762663:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.762668:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.764966:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.764989:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.764995:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765000:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765007:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765038:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765044:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765049:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765055:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765060:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765066:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765072:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765078:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765084:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765090:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765095:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765100:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765106:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765112:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765117:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765124:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765130:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765135:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765141:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765147:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765152:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765158:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765164:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765170:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765177:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765183:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765189:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765217:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765224:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765232:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765238:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765245:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765251:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765257:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765263:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765683:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765689:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765694:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765700:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765705:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765710:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765718:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765723:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765727:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765732:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765737:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765743:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765747:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765752:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765756:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765761:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765765:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765770:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.765775:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.768136:0:5875:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e96862c4e00:5875] 0 exiting: rc = 1 00000100:00100000:2.0:1789575631.771601:0:5876:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e96862c4a00:5876] 1 exiting: rc = 0 00000100:00100000:2.0:1789575631.771916:0:5877:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e96862fce00:5877] 2 exiting: rc = 0 00000100:00100000:2.0:1789575631.771999:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772011:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772018:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772025:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772032:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772040:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772047:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772054:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772061:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772068:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772074:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772081:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772088:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772134:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772140:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772147:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772154:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772174:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772183:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772190:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772197:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772203:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772210:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772217:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772223:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772230:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.772237:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773731:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773754:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773761:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773767:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773773:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773779:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773785:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773792:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773797:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773803:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773808:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773814:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773820:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773826:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773856:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773862:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773868:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773874:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773880:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773886:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773891:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773911:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773917:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773923:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773929:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773935:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773941:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773947:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773953:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773958:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773964:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773971:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773977:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773983:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773990:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.773997:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789575631.774012:0:12896:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789575631.785726:0:12896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575631.785746:0:12896:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789575631.785753:0:12896:0:(genops.c:885:class_export_put()) final put ffff8e9684dbf000/MDS_uuid 00000020:00000080:2.0:1789575631.785759:0:12896:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9684dbf000/MDS_uuid for MDS 00000020:01000000:2.0:1789575631.785766:0:12896:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789575631.786526:0:12896:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789575631.853984:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575632.873575:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575633.323731:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699379328:0@lo:400:kworker.0 00000400:00000100:1.0:1789575633.323805:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876505699379328 offset 0 length 224: 4 00000100:00100000:1.0:1789575633.323897:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575633.323904:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699379456:0@lo:400:kworker.0 00000400:00000100:1.0:1789575633.323927:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699379456 offset 0 length 224: 4 00000100:00100000:1.0:1789575633.323953:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789575633.323961:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699379584:0@lo:400:kworker.0 00000400:00000100:1.0:1789575633.323981:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699379584 offset 0 length 224: 4 00010000:00010000:3.0:1789575633.899732:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789575633.907742:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789575633.907756:0:6734:0:(genops.c:885:class_export_put()) final put ffff8e9584e47800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789575633.909054:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584e47800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789575633.917392:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9584e42800 for lustre-OST0000 00010000:00010000:3.0:1789575634.920648:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789575634.941303:0:13047:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789575634.961152:0:13047:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789575634.961218:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575634.961237:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575634.961245:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575634.961254:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575634.961276:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789575634.961294:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789575634.961329:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789575634.961343:0:13047:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9585825f80 x1876505699379456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575634.961368:0:13047:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789575634.961411:0:13047:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789575634.961450:0:13047:0:(import.c:65:import_set_state_nolock()) ffff8e9584e49800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789575634.961487:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699379712:0@lo:39:umount.0 00000400:00000100:0.0:1789575634.961552:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699379712 offset 0 length 224: 4 00010000:00010000:3.0:1789575634.961679:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575634.961689:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575634.961697:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575634.961700:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575634.961709:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575634.961716:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575634.961722:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789575634.961725:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789575634.961727:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789575634.961761:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575634.961768:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789575634.961799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699379456:0@lo:400:kworker.0 00010000:00010000:3.0:1789575634.961803:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575634.961809:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a22383143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc45cc82a2238314a expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575634.961821:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575634.961840:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575634.961842:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575634.961850:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575634.961862:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699379840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789575634.961907:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575634.962102:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699379840 00000100:00100000:1.0:1789575634.962112:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699379840 00000100:00100000:1.0:1789575634.962169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575634.962178:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1876505699379840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789575634.962186:0:5847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789575634 with bad export cookie 14149404212579544620 00000100:00100000:3.0:1789575634.973942:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1876505699379840:12345-0@lo:103:ldlm_bl.0 Request processed in 11745us (12017us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789575634.973963:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789575634.974245:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789575634.974253:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e968522a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789575634.974257:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789575634.987648:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.132@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789575634.987656:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789575634.987670:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9585824a80 x1876505699379328/t0(0) o400->MGC192.168.202.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789575649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575634.987706:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e96bc238e00 x1876505699379840/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789575650 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789575634.987717:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789575634.987720:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789575634.987721:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789575634.987726:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8e968522a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789575634.987732:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 182 00000100:00080000:1.0:1789575634.987776:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.202.132@tcp: import ffff8e968522a000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575634.988260:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c7100 x1876505699379968/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575634.988328:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:30b00971-c2a0-490d-912f-6313f32cd11c:3306:1876505699379840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575634.988445:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699379968:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789575634.988507:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876505699379968 offset 0 length 520: 4 00000100:00100000:2.0:1789575634.989113:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:30b00971-c2a0-490d-912f-6313f32cd11c:3308:1876505699379328:0@lo:400:kworker.0 00000001:00100000:1.0:1789575635.456291:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789575635.456301:0:7664:0:(genops.c:885:class_export_put()) final put ffff8e9585249800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789575635.456399:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9585249800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789575635.456468:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e958524b000 for lustre-OST0001 00010000:00010000:3.0:1789575635.945865:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575636.969402:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575637.994061:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789575638.440704:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789575638.440719:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789575638.440861:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699380096:0@lo:400:kworker.0 00000400:00000100:2.0:1789575638.440946:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699380096 offset 0 length 224: 4 00010000:00010000:3.0:1789575639.019863:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575640.043401:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575640.488841:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789575640.488859:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789575640.489244:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699380224:0@lo:400:kworker.0 00000400:00000100:1.0:1789575640.489338:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699380224 offset 0 length 224: 4 00010000:00010000:3.0:1789575641.064748:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575642.093102:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575643.112992:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575644.136725:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575644.584572:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575634/real 1789575634] req@ffff8e96bc9c7100 x1876505699379968/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789575644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575644.584627:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bc9c7100 x1876505699379968/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789575644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575644.584641:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575634/real 1789575634] req@ffff8e96bc9c4700 x1876505699379712/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789575644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575644.584668:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bc9c4700 x1876505699379712/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789575644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789575644.584694:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e968522a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789575644.584725:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789575644.584729:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699379968:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789575644.584737:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9584e49800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789575644.584760:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699379712:0@lo:39:umount.0 00000100:00080000:2.0:1789575644.584894:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789575644.584901:0:13047:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789575644.584908:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789575644.585910:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.585949:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.585958:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.585966:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.585993:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575644.586002:0:13047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.586010:0:13047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.586017:0:13047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.586024:0:13047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575644.586048:0:13047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789575644.586053:0:13047:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789575644.586084:0:13047:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789575644.586090:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789575644.586095:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575644.586102:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789575644.586107:0:13047:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e9690ba99c0) has no exports 00000020:00080000:2.0:1789575644.586144:0:13047:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e9690ba99c0) has no exports 00000020:01000000:2.0:1789575644.588193:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e96bc45b120 - data ffff8e969c0d4288/ffff8e96bc3bd800 00000020:01000000:2.0:1789575644.588507:0:13047:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e9699ea6c00 - data ffff8e969c3d6948/ffff8e9585290c00 00010000:00010000:1.0:1789575644.589037:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789575644.589052:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589091:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9680031400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575644.589097:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589109:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575644.589118:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575644.589124:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789575644.589127:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789575644.589132:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789575644.589152:0:5850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:1.0:1789575644.589158:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589166:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680031400/0xc45cc82a22383151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22383158 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589181:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575644.589185:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589191:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2157a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575644.589194:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589202:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575644.589214:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575644.589220:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789575644.589223:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789575644.589226:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789575644.589232:0:5850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:1.0:1789575644.589235:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589242:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2157a00/0xc45cc82a22383388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238338f expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575644.589252:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575644.589254:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575644.589256:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575644.589401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789575644.589408:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789575644.589421:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e968522a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789575644.589432:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1789575644.589439:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789575644.589454:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.132@tcp: import ffff8e968522a000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575644.589500:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c6a00 x1876505699380352/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575644.589591:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699380480:0@lo:400:kworker.0 00000400:00000100:0.0:1789575644.589678:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699380480 offset 0 length 224: 4 00000100:00100000:0.0:1789575644.589771:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699380352:0@lo:250:kworker.0 00000400:00000100:0.0:1789575644.589795:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876505699380352 offset 0 length 520: 4 00010000:00010000:3.0:1789575644.591087:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789575644.609960:0:13047:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789575644.657944:0:13047:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382f60 00000020:00000080:2.0:1789575644.657959:0:13047:0:(genops.c:885:class_export_put()) final put ffff8e9584e49000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789575644.657975:0:13047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9683db2800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789575644.657979:0:13047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9683db2800 2 00000020:01000004:2.0:1789575644.657983:0:13047:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e9683db2800 from lustre-OST0000 00000020:00000080:2.0:1789575644.658014:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575644.658026:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789575644.658030:0:13047:0:(genops.c:885:class_export_put()) final put ffff8e9584e4a000/lustre-OST0000_UUID 00000020:00000080:2.0:1789575644.658033:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584e4a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789575644.658041:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789575644.658094:0:13047:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789575644.658099:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789575644.658103:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575644.658107:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789575644.658116:0:13047:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e958524d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789575644.658122:0:13047:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8e9585103380) has exports, disconnecting them 00000020:00080000:2.0:1789575644.658128:0:13047:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e958524d000), last request at 1789575394 00000020:00000080:2.0:1789575644.658133:0:13047:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382f8a 00000020:00080000:2.0:1789575644.658142:0:13047:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e958524d000): rc 0 00000020:00000080:2.0:1789575644.658146:0:13047:0:(genops.c:885:class_export_put()) final put ffff8e958524d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789575644.659038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584e49000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789575644.659055:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e958524d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789575644.692031:0:13047:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789575644.692049:0:13047:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789575644.692056:0:13047:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789575644.692068:0:13047:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789575644.692399:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575644.692413:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789575644.692440:0:13047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9683db2800 1 00000020:00000080:2.0:1789575644.692449:0:13047:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382f1a 00000020:00000080:2.0:1789575644.692462:0:13047:0:(genops.c:885:class_export_put()) final put ffff8e96bcdb7800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789575644.692613:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e9584e49800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789575644.692633:0:37:0:(genops.c:885:class_export_put()) final put ffff8e9584e4d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789575644.692637:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9584e4d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789575644.692653:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789575644.693115:0:13047:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789575644.693187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bcdb7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789575644.693245:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789575644.693255:0:13047:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789575644.693260:0:13047:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e9699e619c0) has no exports 00000020:00000080:1.0:1789575644.728994:0:13047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789575644.729015:0:13047:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789575644.729023:0:13047:0:(genops.c:885:class_export_put()) final put ffff8e9683db1000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789575644.729029:0:13047:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9683db1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789575644.729044:0:13047:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789575644.729265:0:13047:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e9683db6000 00000020:02000400:1.0:1789575644.729338:0:13047:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789575645.165820:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575646.184486:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575647.209585:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789575647.988306:0:13202:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789575648.009568:0:13202:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789575648.009688:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575648.009707:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575648.009716:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575648.009725:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575648.009752:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789575648.009761:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789575648.009797:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789575648.009823:0:13202:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9585824700 x1876505699379584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575648.009852:0:13202:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e96bc238380 x1876505699380096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575648.009866:0:13202:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e96bc9c7480 x1876505699380224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575656 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575648.009882:0:13202:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e96bc9c4000 x1876505699380480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575660 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575648.009898:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789575648.009944:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876505699380224:0@lo:400:kworker.0 00000100:00080000:1.0:1789575648.010018:0:13202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789575648.010059:0:13202:0:(import.c:65:import_set_state_nolock()) ffff8e95850a6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789575648.010261:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575648.010272:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575648.010281:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e95850f0c00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575648.010294:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575648.010305:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575648.010313:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575648.010319:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789575648.010321:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789575648.010324:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789575648.010342:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:3.0:1789575648.010347:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575648.010354:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e95850f0c00/0xc45cc82a22383127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238312e expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575648.010366:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575648.010367:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575648.010474:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575648.010512:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699380096:0@lo:400:kworker.0 00000100:00100000:2.0:1789575648.010714:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699379584:0@lo:400:kworker.0 00000100:00100000:0.0:1789575648.010916:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876505699380480:0@lo:400:kworker.0 00000100:00100000:1.0:1789575648.010952:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699380608:0@lo:39:umount.0 00000400:00000100:1.0:1789575648.011019:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876505699380608 offset 0 length 224: 4 00010000:00010000:1.0:1789575648.232626:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575649.259542:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789575649.706084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789575649.706092:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789575650.280757:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575651.306160:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575652.333091:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575653.353897:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575654.377743:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789575654.828086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789575654.828099:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 30b00971-c2a0-490d-912f-6313f32cd11c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789575655.404045:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575656.427007:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575657.449935:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575658.281270:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575648/real 1789575648] req@ffff8e9585825f80 x1876505699380608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789575658 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575658.281325:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9585825f80 x1876505699380608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789575658 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789575658.281353:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e95850a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789575658.281420:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699380608:0@lo:39:umount.0 00000100:00080000:0.0:1789575658.281580:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789575658.281588:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789575658.281609:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789575658.282916:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.282961:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.282970:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.282979:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.283015:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789575658.283025:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.283033:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.283040:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.283047:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575658.283072:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789575658.283077:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789575658.283104:0:13202:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789575658.283109:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789575658.283116:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789575658.283124:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789575658.283130:0:13202:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e9699e63380) has no exports 00000020:00080000:0.0:1789575658.283172:0:13202:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e9699e63380) has no exports 00010000:00010000:3.0:1789575658.284414:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575658.284434:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284469:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8200 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575658.284474:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284487:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575658.284495:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575658.284501:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789575658.284504:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789575658.284507:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789575658.284531:0:8472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:3.0:1789575658.284537:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284545:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8200/0xc45cc82a22383135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a2238313c expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284569:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575658.284575:0:8472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284581:0:8472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575658.284585:0:8472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284592:0:8472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575658.284607:0:8472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575658.284613:0:8472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789575658.284615:0:8472:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789575658.284617:0:8472:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789575658.284623:0:8472:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:3.0:1789575658.284626:0:8472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284632:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d1a00/0xc45cc82a2238337a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22383381 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575658.284650:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575658.284652:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575658.284654:0:8472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575658.285067:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789575658.295866:0:13202:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e9699c69480 - data ffff8e969c3f8af8/ffff8e96bc60dc00 00000020:01000000:0.0:1789575658.296037:0:13202:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e9682ddf900 - data ffff8e96b1049bd0/ffff8e96bc3ec400 00100000:10000000:2.0:1789575658.326647:0:13202:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789575658.371130:0:13202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a2238302b 00000020:00000080:2.0:1789575658.371145:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96bc352800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789575658.371169:0:13202:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e95850a0800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789575658.371173:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e95850a0800 2 00000020:01000004:2.0:1789575658.371177:0:13202:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e95850a0800 from lustre-OST0001 00000020:00000080:2.0:1789575658.371208:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575658.371222:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789575658.371224:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96bc354000/lustre-OST0001_UUID 00000020:00000080:2.0:1789575658.371228:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc354000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789575658.371238:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789575658.371430:0:13202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 30b00971-c2a0-490d-912f-6313f32cd11c->MGS 00010000:00010000:2.0:1789575658.371454:0:13202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575658.371469:0:13202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575658.371475:0:13202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789575658.371478:0:13202:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789575658.371495:0:13202:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789575658.371515:0:13202:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:2.0:1789575658.371519:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156a00/0xc45cc82a22382f3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22382f44 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575658.371537:0:13202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575658.371545:0:13202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575658.371550:0:13202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789575658.371552:0:13202:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789575658.371554:0:13202:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789575658.371564:0:13202:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e968522a000 00010000:00010000:2.0:1789575658.371566:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e9680030c00/0xc45cc82a2238317b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc45cc82a22383182 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789575658.371586:0:13202:0:(import.c:65:import_set_state_nolock()) ffff8e968522a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789575658.371590:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789575658.371593:0:13202:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789575658.371595:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789575658.371601:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789575658.371616:0:13202:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e96bc9c6a00 x1876505699380352/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789575659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789575658.371640:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789575658.371643:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:3.0:1789575658.372584:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc352800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789575658.372994:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:30b00971-c2a0-490d-912f-6313f32cd11c:3305:1876505699380352:0@lo:250:kworker.0 10000000:01000000:2.0:1789575658.373324:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789575658.373340:0:13202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382e1e 00000020:00000080:2.0:1789575658.373350:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e9684db9000/30b00971-c2a0-490d-912f-6313f32cd11c 00000020:01000000:2.0:1789575658.373364:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.132@tcp (flags='') 00000020:00000080:2.0:1789575658.373414:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575658.373436:0:13202:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789575658.373441:0:13202:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e96879b99c0) has no exports 10000000:01000000:3.0:1789575658.373524:0:5859:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1789575658.373618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9684db9000/30b00971-c2a0-490d-912f-6313f32cd11c for MGC192.168.202.132@tcp 10000000:01000000:2.0:1789575658.373727:0:13202:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.132@tcp: client import never connected 00000100:00080000:2.0:1789575658.373732:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789575658.373736:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789575658.373739:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789575658.373742:0:13202:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789575658.373795:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789575658.373802:0:13202:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.132@tcp (uuid 30b00971-c2a0-490d-912f-6313f32cd11c) 00000020:01000000:2.0:1789575658.373809:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789575658.373813:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789575658.373818:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789575658.373824:0:13202:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e96aa29b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789575658.373829:0:13202:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8e9699e64d40) has exports, disconnecting them 00000020:00080000:2.0:1789575658.373834:0:13202:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e96aa29b800), last request at 1789575417 00000020:00000080:2.0:1789575658.373839:0:13202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22383055 00000020:00080000:2.0:1789575658.373851:0:13202:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e96aa29b800): rc 0 00000020:00000080:2.0:1789575658.373856:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96aa29b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789575658.374480:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e968522a000 for MGC192.168.202.132@tcp 00000020:00000080:3.0:1789575658.374491:0:36:0:(genops.c:885:class_export_put()) final put ffff8e9685229800/30b00971-c2a0-490d-912f-6313f32cd11c 00000020:00000080:3.0:1789575658.374493:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e9685229800/30b00971-c2a0-490d-912f-6313f32cd11c for MGC192.168.202.132@tcp 00000020:01000000:3.0:1789575658.374500:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.132@tcp (30b00971-c2a0-490d-912f-6313f32cd11c) 00000020:00000080:3.0:1789575658.374800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96aa29b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789575658.378516:0:13202:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789575658.378537:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789575658.378545:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789575658.378558:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789575658.378848:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e95850a6800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789575658.379884:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789575658.382882:0:8472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789575658.384156:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789575658.384437:0:5844:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e96837d0c00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1789575658.384556:0:5845:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e9699ecc800:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1789575658.384669:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.385181:0:12805:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8e9586e43a00:12805] 4 exiting: rc = 0 00000100:00100000:3.0:1789575658.385276:0:5846:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e9699ecca00:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1789575658.385336:0:5847:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e9699ecc600:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1789575658.385527:0:8471:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e9584778c00:8471] 3 exiting: rc = 0 00000100:00100000:2.0:1789575658.386930:0:5848:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e969dfd1a00:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1789575658.387259:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387270:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387278:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387285:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387292:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387298:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387315:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387323:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387331:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387339:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387345:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387351:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387358:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387365:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387416:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387428:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387437:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387443:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387449:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387455:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387462:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387468:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387491:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387497:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387504:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387509:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387515:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387521:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387527:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387532:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387537:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387543:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387548:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387554:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387559:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387565:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387570:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387575:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387581:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387586:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387592:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387597:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387602:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387607:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387614:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387619:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387625:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387631:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387636:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387641:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387646:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387652:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387657:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387662:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387668:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387673:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387678:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387691:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387697:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387703:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387710:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387714:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387736:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.387742:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789575658.389758:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789575658.389776:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789575658.389784:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96bc352000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789575658.389790:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bc352000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789575658.389796:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1789575658.389862:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e95850a0800 1 00000020:00000080:0.0:1789575658.389870:0:13202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc45cc82a22382ffa 00000020:00000080:0.0:1789575658.389879:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96888e2800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789575658.389906:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789575658.389913:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789575658.389920:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789575658.389924:0:13202:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e96bbee0000) has no exports 00000020:00000080:3.0:1789575658.390136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96888e2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789575658.426035:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789575658.426073:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789575658.426082:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e95850a7800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789575658.426089:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8e95850a7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789575658.426099:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789575658.426450:0:13202:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e95850a4000 00000020:01000000:3.0:1789575658.426493:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789575658.426500:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789575658.426507:0:13202:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789575658.426512:0:13202:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e9690ba8000) has no exports 00000020:00000080:3.0:1789575658.426556:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789575658.426569:0:13202:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789575658.426573:0:13202:0:(genops.c:885:class_export_put()) final put ffff8e96bcdb2800/OSS_uuid 00000020:00000080:3.0:1789575658.426576:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8e96bcdb2800/OSS_uuid for OSS 00000020:01000000:3.0:1789575658.426587:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789575658.426674:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e9690250000:6709] 2 exiting: rc = 0 00000100:00100000:3.0:1789575658.427296:0:9232:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e9682f56800:9232] 3 exiting: rc = 0 00000100:00080000:0.0:1789575658.434308:0:5858:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789575658.435846:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e96bf424800:6706] 0 exiting: rc = 1 00000100:00100000:0.0:1789575658.435915:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e96888d8200:6708] 1 exiting: rc = 0 00000100:00100000:3.0:1789575658.436542:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436554:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436562:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436570:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436577:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436584:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436590:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436596:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436603:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436609:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436638:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436644:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436650:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436656:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436662:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436668:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436674:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436681:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436687:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436693:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436700:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436705:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436711:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436728:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436736:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.436742:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438281:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438318:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438328:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438335:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438342:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438349:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438357:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438363:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438383:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438391:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438408:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438416:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438422:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438428:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438435:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438440:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438446:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438454:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438462:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438497:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438506:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438515:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438521:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438529:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438551:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438565:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438572:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438580:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438586:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438593:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438600:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438606:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438614:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438621:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438627:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438634:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438640:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.438653:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.444562:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e968978ee00:6710] 0 exiting: rc = 1 00000100:00100000:2.0:1789575658.450044:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e968978f600:6711] 1 exiting: rc = 0 00000100:00100000:3.0:1789575658.450987:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451000:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451006:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451012:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451018:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451024:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451031:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451036:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451042:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451047:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451338:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451348:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451355:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451362:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451409:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451442:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451454:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451460:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451468:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451474:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451481:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451487:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451495:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451502:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451510:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451517:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451524:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451532:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451540:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451546:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451552:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451559:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451566:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451574:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451582:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451588:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451594:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451600:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451610:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451617:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451624:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451630:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451637:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451643:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451651:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451658:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451664:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451670:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451676:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451682:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451700:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451705:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451711:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451926:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451935:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451942:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451948:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451954:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451960:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451966:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451972:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451978:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.451983:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.452002:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.456747:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e9699eeec00:6713] 1 exiting: rc = 0 00000100:00100000:0.0:1789575658.457243:0:6714:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e96bd0bc200:6714] 2 exiting: rc = 0 00000100:00100000:2.0:1789575658.458586:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e9690b00000:6712] 0 exiting: rc = 1 00000100:00100000:3.0:1789575658.458902:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458913:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458921:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458927:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458933:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458940:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458948:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458956:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458962:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458969:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458976:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458983:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458989:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.458997:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459003:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459022:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459031:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459037:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459044:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459050:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459075:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459082:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459088:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459095:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459103:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459110:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459117:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459124:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459136:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459145:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459155:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459163:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459170:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459178:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459185:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459196:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459203:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459210:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459217:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459254:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459262:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459269:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459276:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459283:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459291:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459298:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459305:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459312:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459319:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459326:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459333:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459339:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459346:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459353:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459359:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459404:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459412:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459420:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459427:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459434:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459441:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459447:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459454:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.459460:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.478617:0:6715:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e96bd0bc400:6715] 0 exiting: rc = 1 00000100:00100000:3.0:1789575658.479689:0:6716:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e96bc547600:6716] 1 exiting: rc = 0 00000100:00100000:0.0:1789575658.480045:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480058:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480065:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480086:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480102:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480109:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480116:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480130:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480139:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480179:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480186:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480199:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480210:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480218:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480225:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480306:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480316:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480322:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480330:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480336:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480343:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480349:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480355:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480361:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480404:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480416:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480426:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480433:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480442:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480449:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480455:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480466:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480474:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480483:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480510:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480520:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480528:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480536:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480543:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480551:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480558:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480566:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480573:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480581:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480599:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480608:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480616:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480624:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480630:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480637:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480645:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480652:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480660:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480670:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480678:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480685:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480691:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480698:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480704:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.480712:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.481351:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.481360:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.481367:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.482129:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789575658.485771:0:6717:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e96bd0bc600:6717] 0 exiting: rc = 1 00000100:00100000:1.0:1789575658.489449:0:6718:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e96bd0bdc00:6718] 1 exiting: rc = 0 00000100:00100000:0.0:1789575658.500080:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500111:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500131:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500140:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500148:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500155:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500162:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500170:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500176:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500185:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500194:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500201:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500208:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500216:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500239:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500265:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500273:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500280:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500288:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500294:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500308:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500316:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500323:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500331:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500338:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500345:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500365:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500411:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500420:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500427:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500437:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500444:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500453:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500463:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500473:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500483:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500491:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500500:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500527:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500536:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500544:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500553:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500563:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500571:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500580:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500589:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500597:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500605:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500613:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500620:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500650:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500658:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500666:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500673:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500680:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500688:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500696:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500705:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.500712:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.502823:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.502847:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.502865:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.502875:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789575658.502883:0:13202:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789575658.539257:0:13202:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789575680.524158:0:13822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789575690.345886:0:14282:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789575690.345895:0:14282:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789575690.346175:0:14282:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e96bd0ce000 00000020:01000004:1.0:1789575690.346191:0:14282:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789575690.346198:0:14282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789575690.346213:0:14282:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e9699e619c0) 00000020:00000080:1.0:1789575690.346227:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789575690.369878:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789575690.373969:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789575690.374760:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1789575690.374865:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1789575690.374962:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789575690.375146:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789575690.375249:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1789575690.375792:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789575690.375871:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1789575690.376208:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1789575690.377870:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 490: rc = 0 00100000:10000000:0.0:1789575690.378229:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 490: rc = 0 00100000:10000000:0.0:1789575690.379188:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.379743:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 612: rc = 0 00100000:10000000:0.0:1789575690.380203:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.380694:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 612: rc = 0 00100000:10000000:0.0:1789575690.380931:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.381347:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 612: rc = 0 00100000:10000000:0.0:1789575690.381926:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 612: rc = 0 00100000:10000000:0.0:1789575690.382230:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.382774:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 612: rc = 0 00100000:10000000:0.0:1789575690.383010:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.383338:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 612: rc = 0 00100000:10000000:0.0:1789575690.383926:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 612: rc = 0 00100000:10000000:0.0:1789575690.384923:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 650: rc = 0 00100000:10000000:0.0:1789575690.385296:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 650: rc = 0 00100000:10000000:0.0:1789575690.386815:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 650: rc = 0 00100000:10000000:0.0:1789575690.387226:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 650: rc = 0 00100000:10000000:0.0:1789575690.387887:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 650: rc = 0 00100000:10000000:0.0:1789575690.388864:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 650: rc = 0 00100000:10000000:0.0:1789575690.389305:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 650: rc = 0 00100000:10000000:2.0:1789575690.390731:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 650: rc = 0 00100000:10000000:2.0:1789575690.391745:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 650: rc = 0 00100000:10000000:2.0:1789575690.392192:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 650: rc = 0 00100000:10000000:2.0:1789575690.392559:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 650: rc = 0 00100000:10000000:2.0:1789575690.393537:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 650: rc = 0 00100000:10000000:2.0:1789575690.395356:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 650: rc = 0 00100000:10000000:2.0:1789575690.397179:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 650: rc = 0 00100000:10000000:2.0:1789575690.398298:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 650: rc = 0 00100000:10000000:2.0:1789575690.398651:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 650: rc = 0 00100000:10000000:2.0:1789575690.398908:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 650: rc = 0 00100000:10000000:2.0:1789575690.400201:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 650: rc = 0 00100000:10000000:2.0:1789575690.400561:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 650: rc = 0 00100000:10000000:2.0:1789575690.401177:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 650: rc = 0 00100000:10000000:2.0:1789575690.401779:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 650: rc = 0 00100000:10000000:2.0:1789575690.402267:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 650: rc = 0 00100000:10000000:2.0:1789575690.403189:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 650: rc = 0 00100000:10000000:2.0:1789575690.403938:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 650: rc = 0 00100000:10000000:2.0:1789575690.404486:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 650: rc = 0 00100000:10000000:2.0:1789575690.404776:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 650: rc = 0 00100000:10000000:2.0:1789575690.405063:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 650: rc = 0 00100000:10000000:2.0:1789575690.405426:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 650: rc = 0 00100000:10000000:2.0:1789575690.405679:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 650: rc = 0 00100000:10000000:2.0:1789575690.405930:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 650: rc = 0 00100000:10000000:2.0:1789575690.406199:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 650: rc = 0 00100000:10000000:2.0:1789575690.406501:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 650: rc = 0 00100000:10000000:2.0:1789575690.406875:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 648: rc = 0 00100000:10000000:3.0:1789575690.407883:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789575690.408544:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 491: rc = 0 00100000:10000000:3.0:1789575690.408768:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789575690.408835:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 491: rc = 0 00100000:10000000:3.0:1789575690.409975:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789575690.410312:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 491: rc = 0 00100000:10000000:3.0:1789575690.410920:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789575690.411154:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 274: rc = 0 00100000:10000000:3.0:1789575690.411365:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789575690.411541:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 274: rc = 0 00100000:10000000:3.0:1789575690.411751:0:14282:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789575690.411819:0:14282:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 274: rc = 0 00000020:00000080:3.0:1789575690.412632:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789575690.412644:0:14282:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789575690.412660:0:14282:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22384111 00000020:01000004:3.0:1789575690.412671:0:14282:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789575690.412677:0:14282:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789575690.412683:0:14282:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e96bd0ce000 from MGS 00000020:01000004:3.0:1789575690.412687:0:14282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789575690.412707:0:14282:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e96919ab380) 00000020:00000080:3.0:1789575690.412717:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789575690.412763:0:14282:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e96bd0ce000 from MGS, refs=2 00080000:01000000:3.0:1789575690.412766:0:14282:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789575690.412769:0:14282:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a2238411f 00000100:00100000:3.0:1789575690.412855:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789575690.413087:0:14282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789575690.413093:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789575690.413772:0:14282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789575690.413781:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789575690.414715:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575690.414903:0:14282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789575690.414908:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789575690.417175:0:14282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789575690.417194:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789575690.417665:0:14282:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789575690.417672:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789575690.419358:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.419362:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.419363:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.419827:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.419829:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.419831:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575690.420406:0:14282:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789575690.424710:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789575690.434810:0:14282:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789575690.434831:0:14282:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789575690.434841:0:14282:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789575690.437279:0:14291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789575690.437410:0:14282:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789575690.437514:0:14282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789575690.437993:0:14282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789575690.438452:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575690.438626:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789575690.438633:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789575690.441990:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789575690.442008:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789575690.442476:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789575690.442482:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1789575690.447131:0:14296:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789575690.447213:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789575690.447234:0:14282:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.132@tcp' 00000020:01000004:1.0:1789575690.447236:0:14282:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789575690.447264:0:14282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.132@tcp (typ=mgc) 00000020:00000080:1.0:1789575690.447275:0:14282:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.132@tcp (ffff8e9699e60000) 00000020:00000080:1.0:1789575690.447290:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789575690.447365:0:14282:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e96bd0cf000@MGC192.168.202.132@tcp: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789575690.447672:0:14282:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.132@tcp-0 is initialized 00000040:01000000:1.0:1789575690.447679:0:14282:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789575690.450636:0:14297:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789575690.450693:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.132@tcp (uuid 75adfecc-338c-4204-8932-8d3be75fd826) 00000020:00000080:1.0:1789575690.450720:0:14282:0:(genops.c:1384:class_connect()) connect: client 75adfecc-338c-4204-8932-8d3be75fd826, cookie 0xc45cc82a2238412d 00000100:00080000:1.0:1789575690.450732:0:14282:0:(import.c:545:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789575690.450745:0:14282:0:(import.c:666:import_select_connection()) MGC192.168.202.132@tcp: import ffff8e96bd0cf000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789575690.450780:0:14282:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9585825f80 x1876505699380736/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789575690.450808:0:14282:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 75adfecc-338c-4204-8932-8d3be75fd826->MGS 00000020:01000004:1.0:1789575690.450825:0:14282:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789575690.450830:0:14282:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789575690.450843:0:14282:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e9699e64d40) 00000020:00000080:1.0:1789575690.450855:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789575690.451046:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75adfecc-338c-4204-8932-8d3be75fd826:3305:1876505699380736:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789575690.451158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.451260:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699380736 00000100:00100000:0.0:1789575690.451269:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699380736 00000100:00100000:0.0:1789575690.451302:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575690.451309:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876505699380736:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789575690.451332:0:14292:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 75adfecc-338c-4204-8932-8d3be75fd826@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1789575690.451356:0:14292:0:(genops.c:1384:class_connect()) connect: client 75adfecc-338c-4204-8932-8d3be75fd826, cookie 0xc45cc82a2238413b 00000100:00080000:0.0:1789575690.451524:0:14292:0:(import.c:65:import_set_state_nolock()) ffff8e9691a39000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789575690.451584:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+5:3305:x1876505699380736:12345-0@lo:250:mount.lustre.0 Request processed in 274us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.451592:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575690.451645:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789575690.451655:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.132@tcp: connect to target with instance 0 00000100:00080000:0.0:1789575690.451664:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789575690.451668:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789575690.451672:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e96bd0cf000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789575690.451674:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789575690.451679:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789575690.451685:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:75adfecc-338c-4204-8932-8d3be75fd826:3305:1876505699380736:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789575690.467072:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575690.467303:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789575690.467311:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789575690.472745:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789575690.472767:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789575690.481146:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789575690.481161:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789575690.483349:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575690.483890:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789575690.483896:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789575690.485834:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789575690.486090:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789575690.552322:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789575690.552632:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789575690.552639:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789575690.554363:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789575690.554409:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789575690.555321:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789575690.555783:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789575690.555788:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789575690.556775:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789575690.556786:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789575690.557578:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789575690.557777:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789575690.557784:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789575690.558685:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789575690.558695:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789575690.559763:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789575690.560126:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789575690.560141:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789575690.561155:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789575690.561165:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789575690.586671:0:14282:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575690.587175:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789575690.587183:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789575690.589245:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789575690.589264:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789575690.590621:0:14282:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789575690.590633:0:14282:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789575690.592713:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789575690.592737:0:14282:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789575690.592744:0:14282:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789575690.592881:0:14282:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789575690.593111:0:14282:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789575690.593115:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789575690.593117:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789575690.593119:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789575690.593120:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789575690.593121:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789575690.593123:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789575690.593124:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789575690.593125:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789575690.593127:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789575690.593128:0:14282:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789575690.593131:0:14282:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789575690.593133:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789575690.593134:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789575690.593136:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789575690.593137:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789575690.593138:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789575690.593139:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789575690.593139:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789575690.593140:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789575690.593141:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789575690.593142:0:14282:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789575690.593168:0:14282:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789575690.593188:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699380864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789575690.593270:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.593368:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575690.593701:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699380864 00000100:00100000:3.0:1789575690.593709:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699380864 00000100:00100000:3.0:1789575690.593794:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575690.593805:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+5:14282:x1876505699380864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789575690.593863:0:14295:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789575690.593867:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789575690.593870:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789575690.594694:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789575690.595438:0:14295:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789575690.597342:0:14317:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789575690.597353:0:14317:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789575690.597356:0:14317:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789575690.597674:0:14317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789575690.598244:0:14295:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789575690.598265:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789575690.607897:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+5:14282:x1876505699380864:12345-0@lo:253:mount.lustre.0 Request processed in 14072us (14605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.607927:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575690.608226:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699380864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789575690.608245:0:14282:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789575690.608248:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789575690.608250:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789575690.608253:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789575690.608254:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789575690.608255:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789575690.608256:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789575690.608257:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789575690.608277:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789575690.608279:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789575690.608281:0:14282:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789575690.608302:0:14282:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e96bd0ce000 from lustre-MDT0000 10000000:01000000:0.0:1789575690.608333:0:14282:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789575690.608336:0:14282:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789575690.608341:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e9699e60000 10000000:01000000:0.0:1789575690.608345:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789575690.608355:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e9699e60000 from 1 10000000:01000000:0.0:1789575690.608358:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789575690.608444:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.608457:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.608468:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.608492:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699380992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575690.608620:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.608664:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.608806:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699380992 00000100:00100000:1.0:1789575690.608815:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699380992 00000100:00100000:1.0:1789575690.608849:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575690.608857:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+5:14282:x1876505699380992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575690.608873:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575690.608900:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87800/0xc45cc82a22384149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384142 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.608935:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87800/0xc45cc82a22384149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384142 expref: 6 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.608946:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87800/0xc45cc82a22384149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384142 expref: 6 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.608955:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87800, rc 0) 00000100:00100000:1.0:1789575690.608989:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+6:14282:x1876505699380992:12345-0@lo:101:mount.lustre.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.608995:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789575690.609280:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699380992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575690.609295:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.609303:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.609354:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575690.609488:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.609590:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.609664:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381120 00000100:00100000:1.0:1789575690.609669:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381120 00000100:00100000:1.0:1789575690.609696:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575690.609703:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+6:14282:x1876505699381120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575690.610332:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+6:14282:x1876505699381120:12345-0@lo:501:mount.lustre.0 Request processed in 627us (842us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789575690.610340:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575690.610632:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381120:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789575690.610666:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789575690.610677:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.610686:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575690.610695:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e96bd0ce000 10000000:01000000:0.0:1789575690.610701:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789575690.610706:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e96bd0ce000 10000000:01000000:0.0:1789575690.610708:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789575690.610711:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e96bd0ce000 from 1 10000000:01000000:0.0:1789575690.610714:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789575690.610738:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.610745:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.610752:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.610768:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575690.610801:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.610839:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.610899:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381248 00000100:00100000:1.0:1789575690.610911:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381248 00000100:00100000:1.0:1789575690.610951:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789575690.610960:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+6:14282:x1876505699381248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575690.610969:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575690.610981:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86200/0xc45cc82a22384157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384150 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611002:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86200/0xc45cc82a22384157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384150 expref: 7 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611021:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86200/0xc45cc82a22384157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384150 expref: 7 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611029:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86200, rc 0) 00000100:00100000:1.0:1789575690.611057:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+7:14282:x1876505699381248:12345-0@lo:101:mount.lustre.0 Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.611063:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789575690.611208:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575690.611234:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384157 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.611242:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384157 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575690.611254:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789575690.611258:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384157 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.611264:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156800/0xc45cc82a22384150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384157 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575690.611269:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789575690.611273:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789575690.611277:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e96bd0ce000 10000000:01000000:0.0:1789575690.611280:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789575690.611283:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789575690.611285:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789575690.611299:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.611306:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.611313:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.611325:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575690.611358:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.611408:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.611485:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381376 00000100:00100000:1.0:1789575690.611489:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381376 00000100:00100000:1.0:1789575690.611521:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575690.611528:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+7:14282:x1876505699381376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575690.611536:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575690.611545:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87a00/0xc45cc82a22384165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238415e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611576:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87a00/0xc45cc82a22384165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238415e expref: 8 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611584:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87a00/0xc45cc82a22384165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238415e expref: 8 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.611592:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87a00, rc 0) 00000100:00100000:1.0:1789575690.611619:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+8:14282:x1876505699381376:12345-0@lo:101:mount.lustre.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.611625:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575690.611762:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575690.611774:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384165 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.611781:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384165 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.611825:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575690.611850:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.611884:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.612185:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381504 00000100:00100000:1.0:1789575690.612190:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381504 00000100:00100000:1.0:1789575690.612221:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575690.612227:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+8:14282:x1876505699381504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575690.612815:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+9:14282:x1876505699381504:12345-0@lo:501:mount.lustre.0 Request processed in 586us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.612823:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575690.612952:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575690.612990:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575690.613040:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.613077:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968975ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.613318:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381632 00000100:00100000:1.0:1789575690.613325:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381632 00000100:00100000:1.0:1789575690.613362:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789575690.613408:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+9:14282:x1876505699381632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575690.613828:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+9:14282:x1876505699381632:12345-0@lo:503:mount.lustre.0 Request processed in 458us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.613835:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789575690.613938:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699381632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575690.614687:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14318:1876505699381760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575690.614738:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.614782:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575690.614839:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699381760 00000100:00100000:2.0:1789575690.614846:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699381760 00000100:00100000:2.0:1789575690.614881:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789575690.615087:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+9:14318:x1876505699381760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789575690.615430:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+9:14318:x1876505699381760:12345-0@lo:502:llog_process_th.0 Request processed in 532us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575690.615438:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789575690.615717:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14318:1876505699381760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575690.615751:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.615763:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.615766:0:14318:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789575690.615772:0:14318:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789575690.615775:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575690.615791:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e9699e63380) 00000020:00000080:1.0:1789575690.615812:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789575690.615817:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789575690.616178:0:14318:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789575690.616189:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22384173 00000020:00000080:1.0:1789575690.616649:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789575690.616655:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.616659:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.616660:0:14318:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789575690.616664:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.616669:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.616670:0:14318:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789575690.616673:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575690.616682:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e9690ba8000) 00000020:00000080:1.0:1789575690.616695:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789575690.616699:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789575690.616701:0:14318:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789575690.616704:0:14318:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789575690.616710:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789575690.616760:0:14318:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e96bd0ce000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789575690.616775:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e9690ba99c0) 00000020:00000080:1.0:1789575690.616782:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789575690.616833:0:14318:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789575690.616845:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a22384188 00000020:00000080:1.0:1789575690.617138:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789575690.617161:0:14318:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789575690.617167:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc45cc82a2238418f 00080000:01000000:1.0:1789575690.617173:0:14318:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789575690.617177:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a22384196 00010000:00010000:2.0:1789575690.701844:0:14318:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789575690.703121:0:14318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789575690.703351:0:14318:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789575690.704487:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e96bbee3380) 00000020:00000080:2.0:1789575690.704523:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789575690.704621:0:14318:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789575690.704630:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a223841a4 00000020:00000080:3.0:1789575690.705722:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789575690.714312:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc45cc82a223841ab 00000020:00000080:1.0:1789575690.717238:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789575690.717260:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.717269:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.717271:0:14318:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789575690.717275:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789575690.717279:0:14318:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789575690.717280:0:14318:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789575690.717282:0:14318:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789575690.717283:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789575690.717286:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.717288:0:14318:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789575690.717290:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.717296:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.717297:0:14318:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789575690.717301:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789575690.717357:0:14318:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789575690.717403:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.717408:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.717410:0:14318:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789575690.717413:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789575690.717417:0:14318:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789575690.717429:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.717430:0:14318:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789575690.717434:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789575690.717441:0:14318:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:1.0:1789575690.717517:0:14318:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789575690.717520:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575690.717546:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e9690bacd40) 00000020:00000080:1.0:1789575690.717575:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789575690.717602:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789575690.717682:0:14318:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789575690.717688:0:14318:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789575690.717697:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a223841b9 00010000:00080000:1.0:1789575690.717777:0:14318:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e9684dbf000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789575690.718163:0:14318:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789575690.718750:0:14318:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789575690.718805:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789575690.719927:0:14318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789575690.720011:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789575690.723677:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789575690.732987:0:14322:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789575690.732997:0:14322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789575690.734224:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789575690.734240:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789575690.734278:0:14318:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789575690.734301:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a223841c0 00000100:00080000:0.0:1789575690.734312:0:14318:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575690.734326:0:14318:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9684dbf000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575690.734575:0:14318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c6a00 x1876505699381888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789575690.734607:0:14318:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789575690.734723:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575690.734753:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.734755:0:14318:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789575690.734759:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789575690.734762:0:14318:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789575690.734764:0:14318:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789575690.734765:0:14318:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789575690.734767:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789575690.734770:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.734771:0:14318:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789575690.734774:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789575690.734780:0:14318:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789575690.734784:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.734785:0:14318:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789575690.734788:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789575690.734793:0:14318:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789575690.734826:0:14318:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789575690.734828:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789575690.734845:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e9585104d40) 00000020:00000080:0.0:1789575690.734863:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789575690.734869:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789575690.734983:0:14318:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789575690.734990:0:14318:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789575690.734997:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc45cc82a223841ce 00010000:00080000:0.0:1789575690.735110:0:14318:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e9686553800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789575690.735311:0:14318:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789575690.735608:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699381888:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789575690.735666:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876505699381888 offset 0 length 520: 4 00000040:01000000:0.0:1789575690.735938:0:14318:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789575690.735966:0:14318:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789575690.736917:0:14318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575690.736997:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789575690.737265:0:14318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789575690.738145:0:14324:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789575690.738150:0:14324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789575690.739167:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789575690.739182:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789575690.739232:0:14318:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789575690.739255:0:14318:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a223841d5 00000100:00080000:0.0:1789575690.739267:0:14318:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575690.739279:0:14318:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575690.739318:0:14318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c4000 x1876505699382016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789575690.739408:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699382016:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789575690.739633:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876505699382016 offset 0 length 520: 4 00000100:00080000:0.0:1789575690.739716:0:14318:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789575690.739772:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575690.739776:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.739779:0:14318:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789575690.739782:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575690.739786:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.739787:0:14318:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789575690.739791:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789575690.739793:0:14318:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789575690.739795:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575690.739797:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.739798:0:14318:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789575690.739801:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575690.739803:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.739804:0:14318:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789575690.739808:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789575690.739835:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14318:1876505699382144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.739899:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.739940:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382144 00000100:00100000:0.0:1789575690.739948:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382144 00000100:00100000:0.0:1789575690.739987:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575690.739995:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+9:14318:x1876505699382144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.740257:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+9:14318:x1876505699382144:12345-0@lo:502:llog_process_th.0 Request processed in 262us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.740274:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575690.740316:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96897f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.740336:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14318:1876505699382144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789575690.740361:0:14318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575690.740365:0:14318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575690.740366:0:14318:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789575690.740395:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789575690.740475:0:14282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789575690.740737:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789575690.740754:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384165 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.740766:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156000/0xc45cc82a2238415e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384165 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575690.740773:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e96bd0ce000 from 1 10000000:01000000:0.0:1789575690.740776:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789575690.740806:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.740815:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.740824:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.740838:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575690.740869:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.740954:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96897f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575690.741310:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382272 00000100:00100000:2.0:1789575690.741316:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382272 00000100:00100000:2.0:1789575690.741355:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575690.741364:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+9:14282:x1876505699382272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789575690.741401:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575690.741424:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223841dc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.741447:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223841dc expref: 10 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.741469:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223841dc expref: 10 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.741477:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3c00, rc 0) 00000100:00100000:2.0:1789575690.741702:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+10:14282:x1876505699382272:12345-0@lo:101:mount.lustre.0 Request processed in 338us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575690.741709:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789575690.742002:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575690.742085:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.742095:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.742873:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382400:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789575690.743127:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.743220:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96897f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575690.743282:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382400 00000100:00100000:2.0:1789575690.743291:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382400 00000100:00100000:2.0:1789575690.743366:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789575690.743669:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+10:14282:x1876505699382400:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789575690.743692:0:14292:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789575690.743699:0:14292:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789575690.743849:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+10:14282:x1876505699382400:12345-0@lo:256:mount.lustre.0 Request processed in 288us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.743856:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789575690.743968:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382400:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789575690.746866:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789575690.747174:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.747190:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575690.747199:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e96bd0ce000 from 1 10000000:01000000:0.0:1789575690.747202:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575690.747248:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.747257:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.747268:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575690.747344:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789575690.748231:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.748326:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96897f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575690.748665:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382528 00000100:00100000:2.0:1789575690.748674:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382528 00000100:00100000:0.0:1789575690.748823:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789575690.748834:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+10:14282:x1876505699382528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575690.748852:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575690.748876:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223841ea expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.748980:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.748992:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.749001:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2157a00, rc 0) 00000100:00100000:0.0:1789575690.749189:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699382528:12345-0@lo:101:mount.lustre.0 Request processed in 357us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.749197:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789575690.749293:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575690.749311:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.749333:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575690.749436:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575690.749468:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.749599:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291480 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.749711:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382656 00000100:00100000:0.0:1789575690.749717:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382656 00000100:00100000:0.0:1789575690.749753:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789575690.749760:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699382656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575690.750439:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699382656:12345-0@lo:501:mount.lustre.0 Request processed in 677us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.750446:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789575690.750648:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575690.750684:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575690.750724:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.750794:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291480 going to sleep for 11 seconds 00000100:00100000:2.0:1789575690.750838:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382784 00000100:00100000:2.0:1789575690.750844:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382784 00000100:00100000:2.0:1789575690.750978:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789575690.750986:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699382784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789575690.751173:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699382784:12345-0@lo:503:mount.lustre.0 Request processed in 187us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575690.751179:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789575690.751250:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699382784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575690.751826:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14326:1876505699382912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575690.751870:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.752161:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.752216:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699382912 00000100:00100000:0.0:1789575690.752222:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699382912 00000100:00100000:0.0:1789575690.752254:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789575690.752261:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14326:x1876505699382912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.752528:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14326:x1876505699382912:12345-0@lo:502:llog_process_th.0 Request processed in 266us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.752536:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575690.752733:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14326:1876505699382912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575690.752761:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.752774:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.752778:0:14326:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789575690.752786:0:14326:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e96bd0ce000 00000020:00000080:1.0:1789575690.752790:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789575690.752800:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.752802:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.752804:0:14326:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789575690.752806:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.752808:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.752815:0:14326:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789575690.752820:0:14326:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e96bd0ce000 00000020:00000080:1.0:1789575690.752822:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789575690.752903:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.752908:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.752909:0:14326:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789575690.752912:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789575690.752915:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.752917:0:14326:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789575690.752920:0:14326:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e96bd0ce000 00000020:00000080:1.0:1789575690.752922:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789575690.752965:0:14326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14326:1876505699383040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575690.753003:0:14326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575690.753042:0:14326:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.755047:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383040 00000100:00100000:1.0:1789575690.755061:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383040 00000100:00100000:1.0:1789575690.755127:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575690.755140:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14326:x1876505699383040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789575690.755480:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14326:x1876505699383040:12345-0@lo:502:llog_process_th.0 Request processed in 341us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.755488:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575690.755728:0:14326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14326:1876505699383040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789575690.755769:0:14326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789575690.755780:0:14326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575690.755782:0:14326:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789575690.755789:0:14326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789575690.760547:0:14282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789575690.760582:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575690.760600:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.760614:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575690.760674:0:14282:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789575690.760682:0:14282:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e96bd0ce000 10000000:01000000:2.0:1789575690.760685:0:14282:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e96bd0ce000 10000000:01000000:2.0:1789575690.760689:0:14282:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789575690.760695:0:14282:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e96bd0ce000 from 1 10000000:01000000:2.0:1789575690.760699:0:14282:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789575690.760736:0:14282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.760744:0:14282:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.760754:0:14282:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575690.760778:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789575690.760848:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575690.760908:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699f37840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.761171:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383168 00000100:00100000:1.0:1789575690.761180:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383168 00000100:00100000:1.0:1789575690.761228:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789575690.761239:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699383168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575690.761260:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575690.761273:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86c00/0xc45cc82a223841ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223841f8 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.761297:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86c00/0xc45cc82a223841ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223841f8 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.761307:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86c00/0xc45cc82a223841ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223841f8 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575690.761315:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86c00, rc 0) 00000100:00100000:1.0:1789575690.761357:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383168:12345-0@lo:101:mount.lustre.0 Request processed in 120us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.761363:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789575690.764201:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789575690.764236:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841ff expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575690.764250:0:14282:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223841ff expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575690.764339:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789575690.764438:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575690.764487:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699f37840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.766222:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383296 00000100:00100000:1.0:1789575690.766237:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383296 00000100:00100000:1.0:1789575690.766295:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789575690.766306:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575690.767680:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383296:12345-0@lo:501:mount.lustre.0 Request processed in 1373us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.767692:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789575690.769463:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575690.769544:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789575690.769608:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575690.769649:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789575690.771583:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383424 00000100:00100000:1.0:1789575690.771606:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383424 00000100:00100000:1.0:1789575690.771672:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789575690.771684:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575690.772178:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383424:12345-0@lo:503:mount.lustre.0 Request processed in 495us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.772197:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789575690.773131:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575690.780683:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14330:1876505699383552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.780783:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.780841:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383552 00000100:00100000:0.0:1789575690.780849:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383552 00000100:00100000:0.0:1789575690.780919:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789575690.780928:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14330:x1876505699383552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.781645:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14330:x1876505699383552:12345-0@lo:502:llog_process_th.0 Request processed in 716us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.781654:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789575690.781726:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.781752:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14330:1876505699383552:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789575690.781844:0:14330:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789575690.781863:0:14330:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e9585100000) 00000020:00000080:0.0:1789575690.781898:0:14330:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789575690.781995:0:14330:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e96bd0ce000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789575690.782000:0:14330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e96bd0ce000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789575690.782002:0:14330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e96bd0ce000 4 00010000:00080000:0.0:1789575690.783928:0:14330:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e9688988800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789575690.791684:0:14330:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789575690.791926:0:14330:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789575690.791966:0:14330:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789575690.791992:0:14330:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc45cc82a2238420d 00000100:00080000:0.0:1789575690.792005:0:14330:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789575690.792276:0:14330:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e9688988800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575690.792327:0:14330:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c4a80 x1876505699383680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575690.793585:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699383680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789575690.793668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.793790:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383680 00000100:00100000:0.0:1789575690.793800:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383680 00000100:00100000:0.0:1789575690.793841:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575690.793850:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699383680:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789575690.795816:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876505699383680:12345-0@lo:38:llog_process_th.0 Request processed in 1955us (2138us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789575690.795830:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575690.795893:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575690.795901:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9688988800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789575690.796159:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789575690.796164:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699383680:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789575690.796198:0:14330:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789575690.799929:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14330:1876505699383808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.801642:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575690.801868:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.803169:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383808 00000100:00100000:0.0:1789575690.803183:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383808 00000100:00100000:0.0:1789575690.803246:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575690.803258:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14330:x1876505699383808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789575690.806401:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14330:x1876505699383808:12345-0@lo:502:llog_process_th.0 Request processed in 3139us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.806423:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789575690.806583:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:75adfecc-338c-4204-8932-8d3be75fd826:14330:1876505699383808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789575690.806619:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789575690.811251:0:14282:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789575690.811303:0:14282:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575690.811328:0:14282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841ff expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.811342:0:14282:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bcdd2a00/0xc45cc82a223841f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223841ff expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789575690.813121:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789575690.813126:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789575690.813133:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575690.813135:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575690.813136:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575690.813138:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575690.813140:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789575690.813141:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789575690.813143:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575690.813144:0:14282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575690.813148:0:14282:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789575690.813152:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575690.813153:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789575690.813154:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575690.813155:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575690.813157:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575690.813158:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575690.813158:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789575690.813160:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789575690.813162:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575690.813163:0:14282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575690.813197:0:14282:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789575690.813226:0:14282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789575690.813323:0:14282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575690.813401:0:14282:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.813646:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699383936 00000100:00100000:0.0:1789575690.813654:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699383936 00000100:00100000:0.0:1789575690.813708:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789575690.813718:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14282:x1876505699383936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789575690.813748:0:14294:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789575690.813765:0:14294:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789575690.894849:0:14294:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789575690.894872:0:14294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789575690.895575:0:14316:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789575690.895581:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789575690.895605:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.895624:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223841dc expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.895634:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.895674:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.895703:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 12 pid: 14295 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575690.895721:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699384064:0@lo:104: 00000100:00100000:3.0:1789575690.895803:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575690.895872:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575690.896006:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384064 00000100:00100000:0.0:1789575690.896015:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384064 00000100:00100000:0.0:1789575690.896067:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575690.896077:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699384064:12345-0@lo:104: 00010000:00010000:0.0:1789575690.896091:0:14283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575690.896161:0:14283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789575690.896167:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699384064:12345-0@lo:104: Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575690.896174:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789575690.896748:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575690.896756:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.896765:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575690.896769:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.896779:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575690.896788:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575690.896794:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789575690.896842:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.896850:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575690.896885:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.896892:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a223841dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841e3 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.896936:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.896938:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575690.896939:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575690.896962:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789575690.896977:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699384192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789575690.897024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575690.897086:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384192 00000100:00100000:3.0:1789575690.897094:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384192 00010000:00010000:3.0:1789575690.897132:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 13 pid: 14295 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575690.897163:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575690.897172:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+13:3306:x1876505699384192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575690.897185:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575690.897189:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 13 pid: 14295 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897200:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 13 pid: 14295 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897217:0:14285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897225:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789575690.897240:0:14285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001660324s 00010000:00010000:3.0:1789575690.897244:0:14285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897258:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897265:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897271:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897276:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575690.897280:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897287:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897295:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897306:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575690.897340:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+13:3306:x1876505699384192:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575690.897347:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575690.897715:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699384192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575690.897762:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96bcdd3c00/0xc45cc82a223841e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223841dc expref: 12 pid: 14295 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575690.897773:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699384064:0@lo:104: 00010000:00010000:3.0:1789575690.897786:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897802:0:14316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897809:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575690.897815:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d0a00/0xc45cc82a22384214 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575690.917780:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14282:x1876505699383936:12345-0@lo:253:mount.lustre.0 Request processed in 104053us (104448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575690.917796:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789575690.917889:0:14282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14282:1876505699383936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789575690.917980:0:14282:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789575690.917984:0:14282:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789575690.917985:0:14282:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789575690.917987:0:14282:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575690.917988:0:14282:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575690.917989:0:14282:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575690.917990:0:14282:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575690.917991:0:14282:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789575690.917992:0:14282:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789575690.917994:0:14282:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575690.917996:0:14282:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789575690.918012:0:14282:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789575690.925018:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.925201:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575690.925855:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.926151:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575690.926724:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.926890:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575690.928238:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.928621:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575690.928896:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.929246:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789575690.931276:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789575690.931735:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789575690.965197:0:14282:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789575690.965805:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789575690.966211:0:14340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789575690.966303:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575690.971141:0:14340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789575690.971224:0:14340:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789575690.971228:0:14340:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789575690.971353:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789575690.971579:0:14282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789575690.972013:0:14339:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789575690.972018:0:14339:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1789575690.972229:0:14282:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789575690.972238:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789575690.972410:0:14282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575690.974141:0:14282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789575690.975304:0:14282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789575690.975596:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789575690.978030:0:14282:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789575690.988042:0:14282:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789575691.046855:0:14282:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789575691.046983:0:14282:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa6d381953988 00100000:10000000:1.0:1789575691.046993:0:14282:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789575691.057572:0:14282:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789575691.057598:0:14282:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789575691.057634:0:14282:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789575691.057662:0:14282:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789575691.433271:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789575691.885059:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789575692.203597:0:14297:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789575692.203609:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e96bd0ce000 from 6 10000000:01000000:0.0:1789575692.203616:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789575692.203677:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.203693:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.203707:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575692.203741:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699384320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575692.203852:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575692.203928:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eeb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575692.203962:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384320 00000100:00100000:0.0:1789575692.203973:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384320 00000100:00100000:0.0:1789575692.204040:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575692.204055:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+11:14297:x1876505699384320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575692.204074:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575692.204108:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238421b expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.204147:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238421b expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.204188:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238421b expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.204203:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2156a00, rc 0) 00000100:00100000:0.0:1789575692.204248:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699384320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575692.204260:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789575692.204344:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699384320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575692.204366:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.204431:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575692.204515:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699384448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789575692.204572:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575692.204611:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eeb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575692.204636:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384448 00000100:00100000:0.0:1789575692.204643:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384448 00000100:00100000:0.0:1789575692.204687:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789575692.204700:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699384448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789575692.204720:0:14294:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789575692.204750:0:14294:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789575692.204755:0:14294:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789575692.204908:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699384448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 207us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575692.204935:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789575692.204996:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699384448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789575692.205059:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789575692.205072:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575692.205084:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575692.463855:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789575692.905908:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789575693.481938:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575694.506657:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575695.528796:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789575696.296662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789575696.296669:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789575696.296672:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789575696.296676:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789575696.296678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789575696.296682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789575696.296686:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e9688988800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789575696.296704:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e9688988800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789575696.296730:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9585826300 x1876505699384704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789575696.296775:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789575696.296788:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75adfecc-338c-4204-8932-8d3be75fd826:3309:1876505699384576:0@lo:400:kworker.0 00000100:00100000:1.0:1789575696.296867:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575696.296937:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699384704:0@lo:38:kworker.0 00000100:00100000:1.0:1789575696.296970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575696.297025:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384576 00000100:00100000:1.0:1789575696.297035:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384576 00000100:00100000:1.0:1789575696.297094:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789575696.297101:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:3309:x1876505699384576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575696.297152:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:3309:x1876505699384576:12345-0@lo:400:kworker.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575696.297158:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789575696.297210:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75adfecc-338c-4204-8932-8d3be75fd826:3309:1876505699384576:0@lo:400:kworker.0 00000100:00100000:0.0:1789575696.300786:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384704 00000100:00100000:0.0:1789575696.300802:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384704 00000100:00100000:0.0:1789575696.300838:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575696.300845:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876505699384704:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789575696.300874:0:14302:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:0.0:1789575696.300910:0:14302:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc45cc82a22384229 00000004:00100000:0.0:1789575696.300927:0:14302:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789575696.301066:0:14302:0:(import.c:65:import_set_state_nolock()) ffff8e9584720000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789575696.301150:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876505699384704:12345-0@lo:38:kworker.0 Request processed in 305us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575696.301156:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789575696.301276:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e9585826300 x1876505699384704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789575696.301292:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789575696.301299:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789575696.301304:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789575696.301306:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9688988800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789575696.301312:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876505699384704:0@lo:38:kworker.0 00000001:02000400:0.0:1789575696.423356:0:14584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789575696.553109:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575697.587783:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575698.602934:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789575699.578708:0:14734:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe752b6160 20000000:00000080:0.0:1789575699.578730:0:14734:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e96923d8c00 uarg=0000000000000000 20000000:01000000:0.0:1789575699.578767:0:14734:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789575699.578777:0:14734:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789575699.578788:0:14734:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789575699.587791:0:14735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1789575699.587985:0:14734:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789575699.598665:0:14734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789575699.601732:0:14734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.601760:0:14734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.601769:0:14734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.601815:0:14734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.601832:0:14734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575699.601849:0:14734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14734:1876505699384832:0@lo:104: 00000100:00100000:2.0:1789575699.601928:0:14734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575699.601996:0:14734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eeb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575699.602427:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384832 00000100:00100000:3.0:1789575699.602436:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384832 00000100:00100000:3.0:1789575699.602481:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575699.602490:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14734:x1876505699384832:12345-0@lo:104: 00010000:00010000:3.0:1789575699.602503:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602576:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789575699.602582:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14734:x1876505699384832:12345-0@lo:104: Request processed in 94us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575699.602590:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789575699.602613:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575699.602620:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602627:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:3.0:1789575699.602632:0:14288:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602641:0:14288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789575699.602649:0:14288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575699.602654:0:14288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789575699.602687:0:14288:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602695:0:14288:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789575699.602717:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602724:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156600/0xc45cc82a223841ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223841f1 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602754:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575699.602756:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575699.602758:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575699.602781:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75adfecc-338c-4204-8932-8d3be75fd826:3309:1876505699384960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789575699.602820:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575699.602860:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699384960 00000100:00100000:3.0:1789575699.602864:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699384960 00010000:00010000:3.0:1789575699.602885:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 12 pid: 14294 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575699.602913:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575699.602920:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+12:3309:x1876505699384960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575699.602931:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575699.602936:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 12 pid: 14294 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602944:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 12 pid: 14294 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602961:0:14285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602970:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602983:0:14285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.602991:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603004:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603010:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603015:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575699.603033:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603041:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603050:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575699.603062:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575699.603093:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+12:3309:x1876505699384960:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575699.603101:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575699.603145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:75adfecc-338c-4204-8932-8d3be75fd826:3309:1876505699384960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575699.603560:0:14734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2157a00/0xc45cc82a223841f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223841ea expref: 11 pid: 14294 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575699.603574:0:14734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14734:1876505699384832:0@lo:104: 00010000:00010000:2.0:1789575699.603589:0:14734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.603598:0:14734:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.603603:0:14734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.603621:0:14734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96bcdd2600/0xc45cc82a22384230 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575699.626607:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575700.392771:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575690/real 1789575690] req@ffff8e96bc9c4000 x1876505699382016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575700.392807:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bc9c4000 x1876505699382016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575700.392830:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575690/real 1789575690] req@ffff8e96bc9c6a00 x1876505699381888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575700.392843:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bc9c6a00 x1876505699381888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789575700.392863:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789575700.392886:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789575700.392891:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699382016:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789575700.392897:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9684dbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789575700.392902:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789575700.392905:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699381888:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789575700.393160:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699385088:0@lo:400:kworker.0 00000100:00100000:3.0:1789575700.393233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789575700.393320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789575700.393333:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789575700.393335:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9684dbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789575700.393340:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:2.0:1789575700.393346:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789575700.393355:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9684dbf000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575700.393398:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bbd07480 x1876505699385216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789575700.393417:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789575700.393421:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789575700.393423:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789575700.393426:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:2.0:1789575700.393429:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789575700.393433:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575700.393447:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bbd04000 x1876505699385344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575700.393507:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385088 00000100:00100000:0.0:1789575700.393516:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385088 00000100:00100000:0.0:1789575700.393560:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789575700.393570:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+11:3306:x1876505699385088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575700.395105:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699385472:0@lo:400:kworker.0 00000100:00100000:1.0:1789575700.395163:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575700.395249:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385472 00000100:00100000:1.0:1789575700.395258:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385472 00000100:00100000:1.0:1789575700.395297:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575700.395305:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699385472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575700.395352:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699385472:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575700.395359:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789575700.395429:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e96bbd04a80 x1876505699385472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575700.395457:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699385472:0@lo:400:kworker.0 00000100:00100000:2.0:1789575700.395969:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699385216:0@lo:8:kworker.0 00000400:00000100:2.0:1789575700.396004:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876505699385216 offset 0 length 520: 4 00000100:00100000:2.0:1789575700.396044:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699385344:0@lo:8:kworker.0 00000400:00000100:2.0:1789575700.396064:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876505699385344 offset 0 length 520: 4 00000100:00100000:0.0:1789575700.396193:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+11:3306:x1876505699385088:12345-0@lo:400:kworker.0 Request processed in 2622us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575700.396202:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789575700.396311:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699385088:0@lo:400:kworker.0 00010000:00010000:3.0:1789575700.650127:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789575701.352745:0:14297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789575701.352758:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e96bd0ce000 from 10 10000000:01000000:3.0:1789575701.352869:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789575701.352949:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575701.352966:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575701.352983:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575701.353036:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575701.353960:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575701.354145:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699d773c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575701.355292:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385600 00000100:00100000:1.0:1789575701.355311:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385600 00000100:00100000:1.0:1789575701.355441:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789575701.355456:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+11:14297:x1876505699385600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575701.355562:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575701.355597:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384237 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575701.355651:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384237 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575701.355746:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384237 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575701.355759:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86000, rc 0) 00000100:00100000:1.0:1789575701.355876:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699385600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 424us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575701.355884:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789575701.355972:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575701.356000:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575701.356023:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575701.358233:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575701.358402:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575701.358463:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575701.359601:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385728 00000100:00100000:1.0:1789575701.359630:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385728 00000100:00100000:1.0:1789575701.359918:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789575701.359933:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699385728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575701.361695:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699385728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1755us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575701.361711:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789575701.365326:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575701.365513:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575701.365663:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575701.365739:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699d77540 going to sleep for 11 seconds 00000100:00100000:1.0:1789575701.366928:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385856 00000100:00100000:1.0:1789575701.366944:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385856 00000100:00100000:1.0:1789575701.367039:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789575701.367051:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699385856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789575701.367424:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14297:x1876505699385856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 373us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575701.367432:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789575701.367947:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699385856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789575701.370180:0:14803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789575701.377081:0:14297:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789575701.377139:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575701.377157:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575701.377174:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575701.673315:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789575702.123132:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789575702.697199:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575703.720592:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575704.745598:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789575705.516160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789575705.516187:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789575705.516191:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789575705.516196:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789575705.516229:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699385984:0@lo:400:kworker.0 00000100:00100000:3.0:1789575705.516234:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699386112:0@lo:400:kworker.0 00000100:00100000:3.0:1789575705.519089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.519534:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386112 00000100:00100000:0.0:1789575705.519552:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386112 00000100:00100000:0.0:1789575705.519642:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575705.519660:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575705.519779:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699386112:12345-0@lo:400:kworker.0 Request processed in 123us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575705.519788:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789575705.519907:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e96bc239880 x1876505699386112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575705.519927:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699386112:0@lo:400:kworker.0 00000100:00100000:0.0:1789575705.520625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575705.520818:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699385984 00000100:00100000:2.0:1789575705.520828:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699385984 00000100:00100000:2.0:1789575705.520890:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789575705.520900:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:3308:x1876505699385984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575705.520984:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:3308:x1876505699385984:12345-0@lo:400:kworker.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.520992:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789575705.521306:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699385984:0@lo:400:kworker.0 00000020:01000004:1.0:1789575705.585912:0:14983:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789575705.585919:0:14983:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789575705.586704:0:14983:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e968522c000 00000020:01000004:1.0:1789575705.586731:0:14983:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789575705.586748:0:14983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789575705.586771:0:14983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e9690bab380) 00000020:00000080:1.0:1789575705.586793:0:14983:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789575705.642737:0:14983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789575705.643162:0:14983:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789575705.644037:0:14983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789575705.644415:0:14983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789575705.644695:0:14983:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789575705.646282:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:2.0:1789575705.646426:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:2.0:1789575705.646751:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:2.0:1789575705.651180:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 200: rc = 0 00100000:10000000:2.0:1789575705.651580:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 200: rc = 0 00100000:10000000:2.0:1789575705.652007:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 200: rc = 0 00100000:10000000:2.0:1789575705.652307:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 200: rc = 0 00100000:10000000:2.0:1789575705.652639:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 200: rc = 0 00100000:10000000:2.0:1789575705.652916:0:14983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 200: rc = 0 00000020:00000080:2.0:1789575705.658434:0:14983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789575705.658454:0:14983:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789575705.658489:0:14983:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc45cc82a2238424c 00000020:01000004:2.0:1789575705.658503:0:14983:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789575705.658534:0:14983:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789575705.658539:0:14983:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789575705.658550:0:14983:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789575705.658556:0:14983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789575705.658575:0:14983:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e96bbee4d40) 00000020:00000080:2.0:1789575705.658587:0:14983:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789575705.673746:0:14983:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575705.674306:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789575705.674313:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789575705.675765:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789575705.675781:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789575705.684707:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789575705.684732:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789575705.692149:0:14983:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789575705.692422:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789575705.692429:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789575705.695986:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789575705.696012:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789575705.728156:0:14983:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575705.728621:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789575705.728629:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789575705.730613:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789575705.730627:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789575705.731610:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789575705.731620:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789575705.734896:0:14983:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789575705.735254:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789575705.735262:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789575705.739020:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789575705.739040:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1789575705.768726:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575705.797777:0:14983:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789575705.798071:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789575705.798080:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789575705.799293:0:14983:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789575705.799304:0:14983:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789575705.799870:0:14983:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789575705.799897:0:14983:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789575705.799907:0:14983:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789575705.810242:0:14983:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789575705.810290:0:14983:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789575705.810295:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789575705.810296:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789575705.810297:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575705.810299:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575705.810300:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575705.810301:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575705.810303:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575705.810305:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575705.810306:0:14983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575705.810310:0:14983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789575705.810313:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575705.810314:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789575705.810315:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575705.810316:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575705.810317:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575705.810318:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575705.810319:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575705.810320:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575705.810321:0:14983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575705.810349:0:14983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789575705.810602:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386240:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789575705.810780:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575705.811044:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf0019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.811203:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386240 00000100:00100000:2.0:1789575705.811212:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386240 00000100:00100000:2.0:1789575705.811554:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789575705.811569:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14983:x1876505699386240:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789575705.811617:0:14294:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789575705.811621:0:14294:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789575705.811626:0:14294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789575705.817076:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc239880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789575705.817095:0:14983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789575705.817097:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789575705.817099:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789575705.817101:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789575705.817102:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789575705.817102:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789575705.817103:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789575705.817104:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789575705.817105:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789575705.817106:0:14983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789575705.817123:0:14983:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e968522c000 from lustre-OST0000 10000000:01000000:1.0:1789575705.817146:0:14983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789575705.817149:0:14983:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789575705.817155:0:14983:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e9699e60000 local copy 00010000:00010000:1.0:1789575705.817163:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575705.817401:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575705.817595:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.817665:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77000 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.817705:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+12:14983:x1876505699386240:12345-0@lo:253:mount.lustre.0 Request processed in 6139us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.817727:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789575705.817768:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386368 00000100:00100000:2.0:1789575705.817776:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386368 00000100:00100000:3.0:1789575705.817826:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789575705.817836:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14983:x1876505699386368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575705.818049:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+12:14983:x1876505699386368:12345-0@lo:501:mount.lustre.0 Request processed in 215us (454us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575705.818054:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789575705.818114:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789575705.818125:0:14983:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789575705.818221:0:14983:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789575705.818230:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.818237:0:14983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575705.818258:0:14983:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e968522c000 10000000:01000000:1.0:1789575705.818261:0:14983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789575705.818264:0:14983:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e9699e60000 10000000:01000000:1.0:1789575705.818265:0:14983:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789575705.818267:0:14983:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e9699e60000 from 1 10000000:01000000:1.0:1789575705.818270:0:14983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789575705.818346:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.818353:0:14983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.818360:0:14983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575705.818429:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789575705.818452:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.818477:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690c77000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575705.818517:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386496 00000100:00100000:3.0:1789575705.818521:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386496 00000100:00100000:3.0:1789575705.818546:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789575705.818551:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+12:14983:x1876505699386496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789575705.818558:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575705.818569:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d0200/0xc45cc82a22384261 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238425a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575705.818585:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d0200/0xc45cc82a22384261 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238425a expref: 13 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575705.818593:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d0200/0xc45cc82a22384261 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238425a expref: 13 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575705.818599:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d0200, rc 0) 00000100:00100000:3.0:1789575705.818683:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+13:14983:x1876505699386496:12345-0@lo:101:mount.lustre.0 Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575705.818687:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789575705.818783:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575705.818793:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384261 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.818799:0:14983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384261 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575705.818809:0:14983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789575705.818820:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384261 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.818825:0:14983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86e00/0xc45cc82a2238425a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384261 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575705.818839:0:14983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789575705.818842:0:14983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789575705.818845:0:14983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789575705.818846:0:14983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789575705.818857:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.818862:0:14983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.818867:0:14983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575705.818874:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575705.818893:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.818992:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575705.819078:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386624 00000100:00100000:1.0:1789575705.819082:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386624 00000100:00100000:1.0:1789575705.819098:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789575705.819102:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+13:14983:x1876505699386624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575705.819106:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575705.819113:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87e00/0xc45cc82a2238426f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384268 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.819128:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87e00/0xc45cc82a2238426f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384268 expref: 14 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.819133:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87e00/0xc45cc82a2238426f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384268 expref: 14 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.819138:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87e00, rc 0) 00000100:00100000:1.0:1789575705.819164:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699386624:12345-0@lo:101:mount.lustre.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.819168:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789575705.819220:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386624:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575705.819227:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238426f expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.819232:0:14983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238426f expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789575705.819718:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789575705.820735:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575705.821030:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789575705.821074:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789575705.821108:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789575705.821182:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789575705.821221:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789575705.821250:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789575705.821766:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789575705.821778:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789575705.821892:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575705.821995:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.822083:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291480 going to sleep for 11 seconds 00000100:00100000:3.0:1789575705.822127:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386752 00000100:00100000:3.0:1789575705.822138:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386752 00000100:00100000:3.0:1789575705.822250:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789575705.822262:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699386752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575705.822809:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699386752:12345-0@lo:501:mount.lustre.0 Request processed in 549us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575705.822817:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789575705.822899:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575705.822936:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575705.822989:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.823099:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96aa291480 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.823162:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699386880 00000100:00100000:2.0:1789575705.823168:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699386880 00000100:00100000:2.0:1789575705.823196:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789575705.823203:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699386880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789575705.823744:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699386880:12345-0@lo:503:mount.lustre.0 Request processed in 539us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.823751:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789575705.824070:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699386880:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789575705.825356:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789575705.825529:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575705.825617:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.825672:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575705.825860:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387008 00000100:00100000:3.0:1789575705.825869:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387008 00000100:00100000:3.0:1789575705.825920:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789575705.825930:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699387008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575705.826228:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699387008:12345-0@lo:502:mount.lustre.0 Request processed in 298us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575705.826235:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789575705.826422:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789575705.826726:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789575705.826782:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789575705.826817:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789575705.826867:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789575705.826903:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789575705.826937:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789575705.827023:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789575705.827061:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789575705.827094:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789575705.827163:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789575705.827201:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789575705.827242:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789575705.827358:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575705.827445:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.827493:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575705.827577:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387136 00000100:00100000:1.0:1789575705.827589:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387136 00000100:00100000:1.0:1789575705.827639:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789575705.827649:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699387136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575705.827825:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699387136:12345-0@lo:502:mount.lustre.0 Request processed in 178us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.827832:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789575705.827923:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789575705.828006:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789575705.828017:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789575705.829345:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789575705.829356:0:14997:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789575705.829365:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.829368:0:14997:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789575705.829575:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789575705.829591:0:14997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e96bbee0000) 00000020:00000080:2.0:1789575705.829622:0:14997:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789575705.829631:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789575705.829717:0:14997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e968522c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789575705.829727:0:14997:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789575705.829734:0:14997:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc45cc82a2238427d 00010000:00010000:2.0:1789575705.833883:0:14997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789575705.834643:0:14997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789575705.836914:0:14997:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789575705.838771:0:14997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789575705.838789:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575705.838797:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838799:0:14997:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789575705.838802:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789575705.838806:0:14997:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789575705.838807:0:14997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789575705.838809:0:14997:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789575705.838810:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789575705.838813:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838814:0:14997:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789575705.838817:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575705.838819:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838821:0:14997:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789575705.838823:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789575705.838825:0:14997:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789575705.838827:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575705.838829:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838843:0:14997:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789575705.838846:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789575705.838848:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838849:0:14997:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789575705.838853:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789575705.838923:0:14997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789575705.838925:0:14997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789575705.838926:0:14997:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789575705.838930:0:14997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789575705.845479:0:14983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789575705.845535:0:14983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789575705.845556:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238426f expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.845571:0:14983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2077e00/0xc45cc82a22384268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238426f expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575705.845594:0:14983:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e968522c000 from 1 10000000:01000000:1.0:1789575705.845597:0:14983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789575705.845641:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.845649:0:14983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.845660:0:14983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575705.845689:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789575705.845768:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.846403:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387264 00000100:00100000:1.0:1789575705.846412:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387264 00000100:00100000:1.0:1789575705.846474:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789575705.846484:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+14:14983:x1876505699387264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575705.846497:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575705.846511:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384284 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.846535:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384284 expref: 15 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.846546:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384284 expref: 15 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.846554:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87600, rc 0) 00000100:00100000:1.0:1789575705.846596:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387264:12345-0@lo:101:mount.lustre.0 Request processed in 112us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.846603:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789575705.846650:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789575705.846673:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789575705.846691:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.846700:0:14983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789575705.847250:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789575705.848904:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789575705.849463:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789575705.849516:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789575705.849578:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789575705.849595:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789575705.849684:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575705.849757:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.849845:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789575705.857129:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387392 00000100:00100000:0.0:1789575705.857151:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387392 00000100:00100000:0.0:1789575705.857228:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789575705.857239:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575705.857604:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387392:12345-0@lo:501:mount.lustre.0 Request processed in 366us (7846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575705.857613:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789575705.860268:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575705.860362:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789575705.860654:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575705.860706:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789575705.862487:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387520 00000100:00100000:0.0:1789575705.862505:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387520 00000100:00100000:0.0:1789575705.862570:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789575705.862582:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575705.862833:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387520:12345-0@lo:503:mount.lustre.0 Request processed in 253us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575705.862858:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789575705.863014:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789575705.863647:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789575705.863744:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789575705.863818:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575705.863871:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789575705.864083:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387648 00000100:00100000:0.0:1789575705.864094:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387648 00000100:00100000:0.0:1789575705.864135:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789575705.864144:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575705.866222:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387648:12345-0@lo:502:mount.lustre.0 Request processed in 2069us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575705.866237:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789575705.867241:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789575705.867618:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789575705.867696:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789575705.867753:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789575705.867792:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789575705.867829:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789575705.867881:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789575705.867921:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789575705.867970:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789575705.868025:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789575705.868102:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575705.868151:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789575705.869562:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387776 00000100:00100000:0.0:1789575705.869577:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387776 00000100:00100000:0.0:1789575705.869636:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789575705.869647:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575705.869985:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387776:12345-0@lo:502:mount.lustre.0 Request processed in 338us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575705.869993:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789575705.871225:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789575705.871426:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789575705.871440:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789575705.872895:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575705.872907:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.872910:0:15001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789575705.872917:0:15001:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e968522c000 00000020:00000080:2.0:1789575705.872920:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789575705.872928:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575705.872931:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.872932:0:15001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789575705.872934:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575705.872937:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.872938:0:15001:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789575705.872941:0:15001:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e968522c000 00000020:00000080:2.0:1789575705.872943:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789575705.873094:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575705.873098:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.873099:0:15001:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789575705.873114:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789575705.873117:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.873119:0:15001:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789575705.873122:0:15001:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e968522c000 00000020:00000080:2.0:1789575705.873124:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789575705.877614:0:15001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789575705.877631:0:15001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789575705.877633:0:15001:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789575705.877638:0:15001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789575705.877850:0:14983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789575705.877883:0:14983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789575705.877910:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.877938:0:14983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575705.878002:0:14983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789575705.878006:0:14983:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e968522c000 10000000:01000000:0.0:1789575705.878009:0:14983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e968522c000 10000000:01000000:0.0:1789575705.878015:0:14983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789575705.878021:0:14983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e968522c000 from 1 10000000:01000000:0.0:1789575705.878024:0:14983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789575705.878064:0:14983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.878072:0:14983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.878084:0:14983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575705.878110:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789575705.878179:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.878220:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.880116:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699387904 00000100:00100000:2.0:1789575705.880130:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699387904 00000100:00100000:2.0:1789575705.880183:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789575705.880194:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699387904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789575705.880213:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575705.880231:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd3400/0xc45cc82a22384299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384292 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.880259:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd3400/0xc45cc82a22384299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384292 expref: 16 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.880271:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bcdd3400/0xc45cc82a22384299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384292 expref: 16 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.880294:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3400, rc 0) 00000100:00100000:2.0:1789575705.880363:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699387904:12345-0@lo:101:mount.lustre.0 Request processed in 172us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.880387:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789575705.880558:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699387904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575705.880577:0:14983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384299 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.880587:0:14983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384299 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789575705.881207:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789575705.882070:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575705.882351:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789575705.882422:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789575705.882457:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789575705.882501:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789575705.882535:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789575705.882581:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789575705.882615:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789575705.882669:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789575705.882736:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789575705.882775:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789575705.882805:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789575705.882848:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789575705.882884:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789575705.882918:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789575705.882982:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789575705.883020:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789575705.883052:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789575705.883098:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789575705.883131:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789575705.883162:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789575705.883206:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789575705.883243:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789575705.883277:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789575705.883340:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789575705.883403:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789575705.883439:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789575705.883488:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789575705.883525:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789575705.883603:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789575705.883620:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789575705.883741:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575705.883820:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.883869:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.885298:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388032 00000100:00100000:2.0:1789575705.885315:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388032 00000100:00100000:2.0:1789575705.885409:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789575705.885423:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789575705.885795:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388032:12345-0@lo:501:mount.lustre.0 Request processed in 374us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.885803:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789575705.896790:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575705.896870:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575705.896986:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.897049:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:3.0:1789575705.897390:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388160 00000100:00100000:3.0:1789575705.897399:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388160 00000100:00100000:3.0:1789575705.897451:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789575705.897461:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789575705.897655:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388160:12345-0@lo:503:mount.lustre.0 Request processed in 195us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575705.897662:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789575705.897760:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789575705.898269:0:14983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789575705.900630:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575705.900744:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.900803:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575705.901430:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388288 00000100:00100000:2.0:1789575705.901441:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388288 00000100:00100000:2.0:1789575705.901493:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789575705.901503:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789575705.901801:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388288:12345-0@lo:502:mount.lustre.0 Request processed in 299us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.901810:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789575705.903171:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789575705.904682:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789575705.904766:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789575705.904802:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789575705.904850:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789575705.904886:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789575705.904940:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789575705.904996:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789575705.905060:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789575705.905111:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789575705.905149:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789575705.905185:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789575705.905250:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789575705.908452:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789575705.908565:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789575705.908643:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789575705.908677:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789575705.908708:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789575705.908753:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789575705.908784:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789575705.908812:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789575705.908854:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789575705.908887:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789575705.908920:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789575705.909011:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789575705.909048:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789575705.909080:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789575705.909141:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789575705.909179:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789575705.909211:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789575705.909257:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789575705.911025:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789575705.911108:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789575705.911145:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789575705.911211:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789575705.911249:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789575705.912136:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789575705.912188:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789575705.912221:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789575705.912267:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789575705.912410:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789575705.912485:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575705.912577:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.915245:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96888aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789575705.917783:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388416 00000100:00100000:1.0:1789575705.917801:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388416 00000100:00100000:1.0:1789575705.917871:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789575705.917883:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575705.918525:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388416:12345-0@lo:502:mount.lustre.0 Request processed in 640us (5944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.918535:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789575705.919530:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789575705.919675:0:14983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789575705.919690:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789575705.921834:0:15006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789575705.921851:0:15006:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e96bbee19c0) 00000020:00000080:2.0:1789575705.921876:0:15006:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789575705.921971:0:15006:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e968522c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789575705.921975:0:15006:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e968522c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789575705.921978:0:15006:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e968522c000 3 00010000:00080000:2.0:1789575705.922008:0:15006:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e96bc354000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789575705.923666:0:15006:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789575705.924286:0:15006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789575705.924321:0:15006:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789575705.924335:0:15006:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc45cc82a223842a7 00000100:00080000:2.0:1789575705.924344:0:15006:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789575705.924356:0:15006:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e96bc354000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575705.924415:0:15006:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bbd06300 x1876505699388544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789575705.924441:0:15006:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789575705.925739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789575705.925747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789575705.925750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789575705.925753:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789575705.925828:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699388672:0@lo:400:kworker.0 00000100:00100000:3.0:1789575705.925905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575705.925985:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388672 00000100:00100000:3.0:1789575705.925994:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388672 00000100:00100000:3.0:1789575705.926052:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789575705.926060:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699388672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575705.926107:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699388672:12345-0@lo:400:kworker.0 Request processed in 48us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575705.926115:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789575705.926157:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e96bc239c00 x1876505699388672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575705.926172:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699388672:0@lo:400:kworker.0 00000100:00100000:0.0:1789575705.927439:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699388544:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789575705.927520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575705.927689:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388544 00000100:00100000:1.0:1789575705.927699:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388544 00000100:00100000:1.0:1789575705.927739:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575705.927747:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876505699388544:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789575705.927788:0:14301:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:1.0:1789575705.927844:0:14301:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc45cc82a223842ae 00000004:00100000:1.0:1789575705.927859:0:14301:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789575705.927890:0:14301:0:(import.c:65:import_set_state_nolock()) ffff8e96c1273000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575705.927939:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876505699388544:12345-0@lo:38:llog_process_th.0 Request processed in 191us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.927946:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789575705.928081:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e96bbd06300 x1876505699388544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575705.928092:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575705.928099:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789575705.928106:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789575705.928111:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789575705.928113:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e96bc354000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789575705.928118:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876505699388544:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789575705.939497:0:15006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789575705.940525:0:14983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789575705.940563:0:14983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575705.940581:0:14983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384299 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575705.940594:0:14983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2076a00/0xc45cc82a22384292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384299 expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789575705.940656:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789575705.940659:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789575705.940661:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575705.940662:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575705.940663:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575705.940664:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575705.940666:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575705.940669:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575705.940670:0:14983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575705.940675:0:14983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789575705.940678:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575705.940679:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789575705.940680:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575705.940681:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575705.940682:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575705.940683:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575705.940690:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575705.940691:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575705.940692:0:14983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575705.940726:0:14983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789575705.940750:0:14983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc239c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789575705.940836:0:14983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575705.940880:0:14983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001300 going to sleep for 11 seconds 00000100:00100000:3.0:1789575705.940910:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388800 00000100:00100000:3.0:1789575705.940918:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388800 00000100:00100000:3.0:1789575705.940978:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789575705.940987:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:14983:x1876505699388800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789575705.941029:0:14292:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789575705.941045:0:14292:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789575705.988322:0:14292:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789575705.988424:0:14292:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789575705.989005:0:14316:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789575705.989014:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789575705.989043:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.989064:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238421b expref: 16 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.989074:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.989117:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 16 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.989132:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 16 pid: 14292 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575705.989146:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699388928:0@lo:104: 00000100:00100000:0.0:1789575705.989212:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575705.989273:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690f94240 going to sleep for 11 seconds 00000100:00100000:1.0:1789575705.989455:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699388928 00000100:00100000:1.0:1789575705.989469:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699388928 00000100:00100000:1.0:1789575705.989528:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575705.989538:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699388928:12345-0@lo:104: 00010000:00010000:1.0:1789575705.989553:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989617:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789575705.989624:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699388928:12345-0@lo:104: Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575705.989631:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789575705.989656:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789575705.989663:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699388928:0@lo:104: 00010000:00010000:1.0:1789575705.989664:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989676:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2156400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575705.989680:0:14288:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.989688:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989690:0:14288:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575705.989709:0:14288:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575705.989715:0:14288:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789575705.989742:0:14288:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989748:0:14288:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575705.989780:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989793:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96c2156400/0xc45cc82a2238421b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a22384222 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575705.989809:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575705.989811:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575705.989813:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575705.989822:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575705.989834:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699389056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575705.989869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575705.989929:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389056 00000100:00100000:2.0:1789575705.989935:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389056 00010000:00010000:2.0:1789575705.989970:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 17 pid: 14292 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575705.990004:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789575705.990013:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75adfecc-338c-4204-8932-8d3be75fd826+17:3306:x1876505699389056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575705.990024:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575705.990030:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 17 pid: 14292 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990040:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 17 pid: 14292 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990066:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2156a00/0xc45cc82a22384222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a2238421b expref: 17 pid: 14292 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990080:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990090:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789575705.990107:0:14287:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001660324s 00010000:00010000:2.0:1789575705.990112:0:14287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990131:0:14287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990139:0:14287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990145:0:14287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990151:0:14287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575705.990157:0:14287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990166:0:14287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990195:0:14287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575705.990206:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575705.990426:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75adfecc-338c-4204-8932-8d3be75fd826+16:3306:x1876505699389056:12345-0@lo:103:ldlm_bl.0 Request processed in 414us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575705.990434:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575705.991344:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699389056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575705.991575:0:14316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.991587:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575705.991594:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2077a00/0xc45cc82a223842b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575706.004163:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+15:14983:x1876505699388800:12345-0@lo:253:mount.lustre.0 Request processed in 63164us (63314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575706.004182:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789575706.004328:0:14983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc239c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:14983:1876505699388800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789575706.004346:0:14983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789575706.004351:0:14983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789575706.004353:0:14983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789575706.004354:0:14983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789575706.004355:0:14983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789575706.004357:0:14983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789575706.004358:0:14983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789575706.004360:0:14983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789575706.004361:0:14983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789575706.004363:0:14983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789575706.004421:0:14983:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789575706.007445:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789575706.007674:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789575706.007799:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789575706.007917:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789575706.009884:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789575706.010217:0:14983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789575706.011009:0:14983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789575706.074796:0:14983:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789575706.074806:0:14983:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789575706.074841:0:14983:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789575706.074904:0:14983:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789575706.074927:0:14983:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789575706.074973:0:14983:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789575706.798571:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789575707.439493:0:14297:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789575707.439502:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e96bd0ce000 from 7 10000000:01000000:3.0:1789575707.439509:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789575707.439582:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575707.439609:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575707.439624:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575707.439664:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc23b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699389184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789575707.439765:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575707.446300:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bf001d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789575707.449874:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389184 00000100:00100000:0.0:1789575707.449896:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389184 00000100:00100000:0.0:1789575707.449991:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789575707.450004:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+15:14297:x1876505699389184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575707.450028:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575707.450058:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223842bc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.450096:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223842bc expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.450127:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223842bc expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.450138:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575707.450262:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14297:x1876505699389184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575707.450553:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789575707.450619:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc23b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699389184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575707.450644:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.450674:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575707.450760:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699389312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789575707.450813:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575707.450851:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96b0fd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575707.450873:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389312 00000100:00100000:0.0:1789575707.450878:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389312 00000100:00100000:0.0:1789575707.450897:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789575707.450903:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14297:x1876505699389312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789575707.450921:0:14295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789575707.450958:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789575707.450961:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789575707.451067:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:14297:x1876505699389312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575707.451074:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789575707.451093:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699389312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789575707.451173:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789575707.451181:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.451190:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575707.816672:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575708.840586:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575709.872583:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575710.888679:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789575711.145003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789575711.145013:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789575711.145016:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789575711.145020:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789575711.145092:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699389568:0@lo:400:kworker.0 00000100:00100000:1.0:1789575711.145183:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575711.145489:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699389440:0@lo:400:kworker.0 00000100:00100000:0.0:1789575711.145549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575711.145609:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575711.145623:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699389696:0@lo:400:kworker.0 00000100:00100000:0.0:1789575711.145654:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575711.145702:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389568 00000100:00100000:0.0:1789575711.145712:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389568 00000100:00100000:2.0:1789575711.146461:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389440 00000100:00100000:2.0:1789575711.146471:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389440 00000100:00100000:2.0:1789575711.146539:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789575711.146551:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:3308:x1876505699389440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575711.146645:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:3308:x1876505699389440:12345-0@lo:400:kworker.0 Request processed in 96us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575711.146671:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789575711.147555:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389696 00000100:00100000:1.0:1789575711.147566:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389696 00000100:00100000:1.0:1789575711.147626:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575711.147638:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699389696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575711.147720:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699389696:12345-0@lo:400:kworker.0 Request processed in 86us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575711.147727:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789575711.147806:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9585825c00 x1876505699389696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575711.147824:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699389696:0@lo:400:kworker.0 00000100:00100000:0.0:1789575711.148592:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789575711.148604:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699389568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575711.148664:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699389568:12345-0@lo:400:kworker.0 Request processed in 63us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575711.148671:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789575711.149665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9585827b80 x1876505699389568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575711.149682:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699389568:0@lo:400:kworker.0 00000100:00100000:0.0:1789575711.150108:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699389440:0@lo:400:kworker.0 00000100:00080000:0.0:1789575711.150175:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789575711.913699:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789575712.365199:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789575712.937786:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575713.961056:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789575714.191265:0:15350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789575714.985511:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575715.176840:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575700/real 1789575700] req@ffff8e96bbd07480 x1876505699385216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575715.176905:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bbd07480 x1876505699385216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575715.176923:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789575700/real 1789575700] req@ffff8e96bbd04000 x1876505699385344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789575715.176935:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e96bbd04000 x1876505699385344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789575715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789575715.176964:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9684dbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789575715.189261:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789575715.189277:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699385216:0@lo:8:kworker.0 00000100:00080000:3.0:1789575715.189354:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789575715.189367:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789575715.189403:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699385344:0@lo:8:kworker.0 00000100:00080000:0.0:1789575715.189730:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789575715.189736:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789575715.189740:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9684dbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789575715.189748:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789575715.189756:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789575715.189771:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9684dbf000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575715.189803:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c7480 x1876505699389952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789575715.189818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789575715.189821:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789575715.189829:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789575715.189834:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1789575715.189837:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789575715.189843:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575715.189857:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c4700 x1876505699390080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575715.189924:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575715.189941:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699389824:0@lo:400:kworker.0 00000100:00100000:0.0:1789575715.190127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575715.190272:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699390208:0@lo:400:kworker.0 00000100:00100000:0.0:1789575715.190311:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575715.190430:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575715.190438:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699390336:0@lo:400:kworker.0 00000100:00100000:0.0:1789575715.190464:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575715.190501:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389824 00000100:00100000:0.0:1789575715.190511:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389824 00000100:00100000:0.0:1789575715.190573:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789575715.190583:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:3306:x1876505699389824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575715.190646:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:3306:x1876505699389824:12345-0@lo:400:kworker.0 Request processed in 63us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575715.190655:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789575715.190697:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390208 00000100:00100000:0.0:1789575715.190701:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390208 00000100:00100000:0.0:1789575715.190731:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390336 00000100:00100000:0.0:1789575715.190734:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390336 00000100:00100000:0.0:1789575715.190766:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575715.190772:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575715.190780:0:14302:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789575715.190792:0:14302:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789575715.190823:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699390208:12345-0@lo:400:kworker.0 Request processed in 51us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575715.190831:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575715.190836:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575715.190852:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699390336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789575715.190855:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575715.190908:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699390336:12345-0@lo:400:kworker.0 Request processed in 58us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575715.190914:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575715.190959:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699389824:0@lo:400:kworker.0 00010000:00080000:1.0:1789575715.191000:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c5f80 x1876505699390336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575715.191012:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699390336:0@lo:400:kworker.0 00010000:00080000:1.0:1789575715.191023:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7100 x1876505699390208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575715.191032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699390208:0@lo:400:kworker.0 00000100:00100000:3.0:1789575715.191512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699389952:0@lo:8:kworker.0 00000100:00100000:3.0:1789575715.191564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575715.191611:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699390080:0@lo:8:kworker.0 00000100:00100000:3.0:1789575715.191638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575715.191673:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699389952 00000100:00100000:3.0:1789575715.191679:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699389952 00000100:00100000:3.0:1789575715.191711:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390080 00000100:00100000:3.0:1789575715.191714:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390080 00000100:00100000:1.0:1789575715.191903:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789575715.191911:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699389952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789575715.191953:0:14985:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1789575715.191998:0:14985:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a223842ca 00002000:00100000:1.0:1789575715.192018:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e96c1277000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789575715.192025:0:14985:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789575715.192029:0:14985:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789575715.194256:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789575715.194308:0:14985:0:(import.c:65:import_set_state_nolock()) ffff8e9683db6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575715.194645:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876505699389952:12345-0@lo:8:kworker.0 Request processed in 2728us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575715.194660:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575715.194703:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789575715.194713:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699390080:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789575715.194735:0:14985:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789575715.194771:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699390080:12345-0@lo:8:kworker.0 Request processed in 59us (3131us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789575715.194777:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789575715.197504:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7480 x1876505699389952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789575735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575715.197526:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789575715.197541:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789575715.197554:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789575715.197562:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789575715.197566:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9684dbf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789575715.197593:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789575715.197603:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699389952:0@lo:8:kworker.0 00000004:00080000:2.0:1789575715.197612:0:14322:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789575715.197670:0:14323:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789575715.197698:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14323:1876505699390592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789575715.197774:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575715.197818:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789575715.197844:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699390464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575715.197870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789575715.197948:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789575715.197953:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789575715.197957:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699390080:0@lo:8:kworker.0 00000100:00100000:0.0:1789575715.198682:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390464 00000100:00100000:0.0:1789575715.198699:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390464 00000100:00100000:0.0:1789575715.198765:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575715.198775:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699390464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575715.198832:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575715.198918:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876505699390464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575715.198927:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789575715.198961:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789575715.199068:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7800 x1876505699390464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575715.199088:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699390464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575715.199298:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390592 00000100:00100000:3.0:1789575715.199305:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390592 00000004:00080000:2.0:1789575715.199924:0:14322:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 527286551443ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789575715.199925:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789575715.199936:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14323:x1876505699390592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789575715.202488:0:14986:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789575715.202504:0:14986:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789575715.202512:0:14986:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1789575715.216944:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.217054:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217081:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.217087:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.217096:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217121:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217134:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217142:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217169:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789575715.217795:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.217804:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217816:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.217820:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.217824:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217834:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217850:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.217858:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222701:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789575715.222722:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222739:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575715.222745:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222759:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222792:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222800:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000886b29a/0xc45cc82a223842d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222828:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575715.222849:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222857:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575715.222860:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222869:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222894:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.222903:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575715.222905:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575715.222907:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.229576:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789575715.229604:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.230581:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.231655:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.231669:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231691:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.231697:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.231704:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231723:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231734:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231753:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231771:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.231786:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.231792:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231801:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.231806:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231816:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231839:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231847:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a223842df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.231868:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.231870:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.231886:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.234104:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.234127:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234147:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.234153:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.234160:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234176:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234188:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234197:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234218:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.234237:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.234244:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234253:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.234259:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234269:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234297:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234306:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.234329:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.234332:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.238943:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.240432:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.240452:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.240478:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.240485:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.240493:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.240512:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.240529:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.240538:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.240586:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789575715.241033:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575715.241046:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241059:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575715.241066:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241078:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241105:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241121:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622bff98/0xc45cc82a223842ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241141:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.241143:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789575715.241143:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575715.241145:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.241148:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.241157:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.241161:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.241165:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.241175:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.241184:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.241192:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.241217:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789575715.241248:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575715.241264:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241272:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575715.241286:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241295:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241308:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241316:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618d6005/0xc45cc82a223842f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.241348:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575715.241350:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575715.241354:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.250758:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.250782:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250810:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.250824:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.250833:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250854:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250867:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250890:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250915:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.250934:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.250944:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.250954:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.250962:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.252559:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.252596:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.252618:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000af68816/0xc45cc82a223842fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.252644:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.252647:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.252649:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575715.255703:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575715.255718:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255738:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=527s v=(0 0) 00010000:00010000:3.0:1789575715.255743:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575715.255751:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255769:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255781:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255789:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255819:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.255844:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.255858:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.255867:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.258164:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.258206:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.258241:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.258250:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099cedc65/0xc45cc82a22384302 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.258289:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.258293:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.258296:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.259213:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.259228:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.259248:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.259253:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.259260:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.259344:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.259356:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.259365:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.259492:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575715.260253:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.260261:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.260357:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.260361:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.260366:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260412:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575715.260415:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260429:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.260432:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260471:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.260480:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260508:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260533:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260540:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002de0c3b3/0xc45cc82a22384309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.260568:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.260570:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.260572:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.260642:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.260673:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.261100:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.261109:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.261118:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.261122:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.261132:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.261149:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.261174:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4dae416/0xc45cc82a22384310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.261366:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.261407:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.261409:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.261434:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.261446:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.261461:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.261465:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1789575715.261713:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789575715.261736:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.261759:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.261784:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.261792:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.261849:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575715.262795:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.262805:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.262818:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.262821:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.262827:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.262839:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.262849:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.262858:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.262900:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789575715.263142:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575715.263155:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263169:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.263175:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263186:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263209:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263218:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f059fe01/0xc45cc82a22384317 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263241:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.263244:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263259:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.263263:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263272:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263283:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263291:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a2238431e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.263312:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.263317:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.263319:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.263328:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.263776:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.263785:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.263796:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.263800:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.263805:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.263815:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.263823:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.263832:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.263857:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.264088:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.264097:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264109:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.264114:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264136:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264154:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264162:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b91c6a4d/0xc45cc82a22384325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264200:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.264203:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.264205:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.264686:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.264693:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.264704:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.264713:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.264718:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.264729:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.264737:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.264745:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.264765:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.264818:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.264827:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264838:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.264843:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264854:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.264869:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.265090:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef7330f/0xc45cc82a2238432c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.265118:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.265121:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.265123:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.265724:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.265734:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.265745:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.265748:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.265753:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.265764:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.265773:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.265787:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.265816:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.266153:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.266161:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.266170:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.266175:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.266185:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.266203:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.266209:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0a8e679/0xc45cc82a22384333 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.266229:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.266232:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.266233:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.267196:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.267208:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267220:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.267223:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.267229:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267243:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267253:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267261:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267451:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575715.267944:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.267950:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267966:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.267969:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.267974:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267984:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.267993:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.268000:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268423:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575715.268433:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268443:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.268448:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268459:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268491:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268500:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c840e11/0xc45cc82a2238433a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268541:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.268545:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268552:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.268555:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268562:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268590:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.268599:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.268601:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.268603:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.268755:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.268763:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f632c96a/0xc45cc82a22384341 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.269118:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.269777:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.269784:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.269796:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.269799:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.269805:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.269828:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.269837:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.269845:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.269916:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575715.270396:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.270403:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.270411:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.270414:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.270418:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.270427:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.270435:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.270454:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271001:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575715.271010:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271020:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.271034:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271044:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271064:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271072:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aecbedd1/0xc45cc82a22384348 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271098:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.271100:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271119:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.271123:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271130:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271142:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.271153:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.271156:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.271159:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.271348:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.271356:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036542560/0xc45cc82a2238434f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575715.272241:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.272250:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.272261:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.272264:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.272405:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.272418:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.272427:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.272434:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.272563:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.272571:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.272580:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.272585:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.272595:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.272609:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.272625:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.272627:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.272628:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.272719:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.272724:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000923c7573/0xc45cc82a22384356 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.273116:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.273464:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.273590:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.273603:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.273607:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.273612:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.273623:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.273632:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.273639:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.273694:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575715.274154:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.274161:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.274176:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.274179:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.274184:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.274195:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.274204:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.274211:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274418:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789575715.274425:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274434:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.274439:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274449:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274467:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274487:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863adc68/0xc45cc82a2238435d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274515:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.274520:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274539:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.274551:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274559:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274571:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.274581:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.274582:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.274584:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.274927:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.274933:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384364 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575715.275685:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.275692:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.275705:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.275709:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.275714:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.275740:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.275750:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.275758:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276002:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.276009:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276016:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.276019:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276096:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276111:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276119:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.276129:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.276131:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.276205:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.276211:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d15bdb6/0xc45cc82a2238436b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575715.276830:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.276837:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.276847:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.276850:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.276855:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.276866:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.276898:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.276905:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276960:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.276967:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276974:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.276977:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276986:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.276998:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.277007:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.277008:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.277010:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575715.277109:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575715.277114:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616b3ca7/0xc45cc82a22384372 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.277347:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.277869:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.277887:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.277898:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.277901:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.277905:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.277915:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.277923:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.277942:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.277958:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.278385:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.278392:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.278402:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.278408:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.278428:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.278443:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.278451:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2dc157/0xc45cc82a22384379 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.278468:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.278469:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.278483:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.278744:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.278749:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.278758:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.278761:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.278766:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.278775:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.278784:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.278791:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.278813:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.279108:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.279114:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.279121:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.279125:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.279133:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.279144:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.279162:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde03daf/0xc45cc82a22384380 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.279177:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.279179:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.279181:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575715.280429:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575715.280442:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.280462:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=527s v=(0 0) 00010000:00010000:2.0:1789575715.280466:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575715.280548:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.280565:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.280575:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575715.280582:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.280682:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789575715.280699:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.280708:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.280717:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.280722:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.280731:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.280749:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.280757:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073cad84b/0xc45cc82a22384387 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.280780:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.280782:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.280784:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789575715.281431:0:14986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789575715.281443:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.281461:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=527s v=(0 0) 00010000:00010000:0.0:1789575715.281466:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575715.281472:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.281488:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.281500:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.281509:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575715.281530:0:14986:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789575715.281717:0:14986:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789575715.281865:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14323:x1876505699390592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 81925us (84085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575715.281895:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789575715.282548:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789575715.282560:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.282573:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575715.282578:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.282589:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.282607:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.282617:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cce626d/0xc45cc82a2238438e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575715.282650:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.282652:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575715.282654:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575715.282819:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14323:1876505699390592:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789575715.282839:0:14323:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789575715.282922:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14323:1876505699390720:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789575715.282991:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575715.283110:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390720 00000100:00100000:1.0:1789575715.283124:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390720 00000100:00100000:2.0:1789575715.283186:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b5c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789575715.283194:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575715.283207:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14323:x1876505699390720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789575715.283273:0:14985:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1789575715.292526:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14323:x1876505699390720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9308us (9520us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789575715.292546:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789575715.292663:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14323:1876505699390720:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789575715.292686:0:14323:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789575716.011741:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789575716.459198:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789575716.459245:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789575717.032596:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575718.056623:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575719.081806:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789575720.105716:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789575720.365964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789575720.365972:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789575720.365975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789575720.365997:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:0.0:1789575720.366003:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789575720.366015:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575720.366041:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c7480 x1876505699391104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575720.366092:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699390848:0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.366171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.367105:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699391488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575720.368292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.368347:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575720.368357:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699391360:0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.368417:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.368454:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699390976:0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.368494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.368637:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789575720.368645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699391232:0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.368670:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.368708:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699391104:0@lo:8:kworker.0 00000100:00100000:0.0:1789575720.368732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575720.368767:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390848 00000100:00100000:0.0:1789575720.368776:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390848 00000100:00100000:0.0:1789575720.368822:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789575720.368843:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+16:3307:x1876505699390848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.368912:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+16:3307:x1876505699390848:12345-0@lo:400:kworker.0 Request processed in 82us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575720.368934:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789575720.368970:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391488 00000100:00100000:0.0:1789575720.368974:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391488 00000100:00100000:0.0:1789575720.369008:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575720.369015:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699391488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789575720.369044:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789575720.369076:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699391488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575720.369082:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789575720.369101:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391360 00000100:00100000:0.0:1789575720.369104:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391360 00000100:00100000:0.0:1789575720.369129:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391232 00000100:00100000:0.0:1789575720.369132:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391232 00000100:00100000:0.0:1789575720.369152:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575720.369159:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699391360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.369191:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699391360:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575720.369212:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575720.369226:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789575720.369232:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.369260:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699391232:12345-0@lo:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575720.369264:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789575720.369277:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699390976 00000100:00100000:0.0:1789575720.369280:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699390976 00000100:00100000:0.0:1789575720.369293:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391104 00000100:00100000:0.0:1789575720.369294:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391104 00000100:00100000:0.0:1789575720.369311:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575720.369315:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699390976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.369337:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699390976:12345-0@lo:400:kworker.0 Request processed in 23us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575720.369341:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789575720.369347:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789575720.369350:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876505699391104:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789575720.369362:0:14986:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789575720.373441:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789575720.373450:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789575720.374054:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7100 x1876505699391360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575720.374072:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699391360:0@lo:400:kworker.0 00000100:00100000:2.0:1789575720.374576:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789575720.374604:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699391488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789575720.374617:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699390848:0@lo:400:kworker.0 00010000:00080000:1.0:1789575720.376471:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c5880 x1876505699391232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575720.376488:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699391232:0@lo:400:kworker.0 00000100:00100000:1.0:1789575720.376503:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699390976:0@lo:400:kworker.0 00000100:00100000:0.0:1789575720.399151:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876505699391104:12345-0@lo:8:kworker.0 Request processed in 29791us (30410us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789575720.399165:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789575720.399221:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789575720.399227:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789575720.399232:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699391104:0@lo:8:kworker.0 00010000:00010000:0.0:1789575721.135450:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575722.155016:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789575722.545833:0:15705:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789575722.545838:0:15705:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789575722.545994:0:15705:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e9584e47000 00000020:01000004:3.0:1789575722.546203:0:15705:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789575722.546217:0:15705:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789575722.546234:0:15705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e96919acd40) 00000020:00000080:3.0:1789575722.546270:0:15705:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789575722.594725:0:15705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789575722.595163:0:15705:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789575722.599536:0:15705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789575722.600042:0:15705:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789575722.600365:0:15705:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789575722.601078:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:1.0:1789575722.601210:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:1.0:1789575722.601307:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:1.0:1789575722.601904:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 559: rc = 0 00100000:10000000:1.0:1789575722.602169:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 559: rc = 0 00100000:10000000:1.0:1789575722.602475:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 559: rc = 0 00100000:10000000:1.0:1789575722.602712:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 559: rc = 0 00000040:00080000:2.0:1789575722.604960:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:3.0:1789575722.612702:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 559: rc = 0 00100000:10000000:3.0:1789575722.613101:0:15705:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 559: rc = 0 00000020:00000080:3.0:1789575722.615138:0:15705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789575722.615153:0:15705:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789575722.615165:0:15705:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc45cc82a2238439c 00000020:01000004:3.0:1789575722.615173:0:15705:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789575722.615194:0:15705:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789575722.615198:0:15705:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789575722.615204:0:15705:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789575722.615231:0:15705:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789575722.615236:0:15705:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789575722.630341:0:15705:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789575722.630629:0:15705:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789575722.630634:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789575722.630636:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789575722.630638:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575722.630639:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575722.630640:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575722.630642:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575722.630643:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575722.630645:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575722.630646:0:15705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575722.630650:0:15705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789575722.630653:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575722.630654:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789575722.630655:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575722.630656:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575722.630657:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575722.630658:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575722.630659:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575722.630660:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575722.630662:0:15705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789575722.630705:0:15705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789575722.630728:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789575722.630827:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.630934:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575722.630980:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391616 00000100:00100000:1.0:1789575722.630989:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391616 00000100:00100000:1.0:1789575722.631078:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789575722.631088:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:15705:x1876505699391616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789575722.631122:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789575722.631125:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789575722.631129:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789575722.638188:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:15705:x1876505699391616:12345-0@lo:253:mount.lustre.0 Request processed in 7086us (7346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575722.638207:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789575722.639157:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789575722.639180:0:15705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789575722.639183:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789575722.639185:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789575722.639186:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575722.639188:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575722.639189:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575722.639190:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575722.639192:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575722.639194:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575722.639195:0:15705:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789575722.639219:0:15705:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9584e47000 from lustre-OST0001 10000000:01000000:3.0:1789575722.639250:0:15705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789575722.639260:0:15705:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789575722.639269:0:15705:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e9699e60000 local copy 00010000:00010000:3.0:1789575722.639286:0:15705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575722.639588:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575722.639638:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.639673:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690b95540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575722.639816:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391744 00000100:00100000:0.0:1789575722.639824:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391744 00000100:00100000:0.0:1789575722.639875:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789575722.639885:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:15705:x1876505699391744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575722.640169:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:15705:x1876505699391744:12345-0@lo:501:mount.lustre.0 Request processed in 285us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575722.640177:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789575722.640679:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789575722.640697:0:15705:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789575722.640887:0:15705:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789575722.640896:0:15705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.640907:0:15705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96c2157200/0xc45cc82a22384142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384149 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789575722.640944:0:15705:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9584e47000 10000000:01000000:3.0:1789575722.640949:0:15705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789575722.640954:0:15705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789575722.640957:0:15705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789575722.640962:0:15705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789575722.640965:0:15705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789575722.640995:0:15705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.641003:0:15705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.641013:0:15705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575722.641031:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789575722.641072:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.641199:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690b95540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575722.641560:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699391872 00000100:00100000:0.0:1789575722.641568:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699391872 00000100:00100000:0.0:1789575722.641654:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789575722.641664:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+16:15705:x1876505699391872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575722.641685:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575722.641699:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076600/0xc45cc82a223843aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223843a3 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.641724:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076600/0xc45cc82a223843aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223843a3 expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.641737:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076600/0xc45cc82a223843aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223843a3 expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.641746:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076600, rc 0) 00000100:00100000:0.0:1789575722.641802:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699391872:12345-0@lo:101:mount.lustre.0 Request processed in 139us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.641820:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789575722.641917:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699391872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789575722.641931:0:15705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843aa expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.641941:0:15705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223843aa expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575722.642748:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789575722.644030:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789575722.644546:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789575722.644609:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789575722.644642:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789575722.644685:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789575722.644719:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789575722.644770:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789575722.644857:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789575722.644866:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789575722.644975:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575722.645044:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.645080:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690b95b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789575722.645238:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392000 00000100:00100000:2.0:1789575722.645246:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392000 00000100:00100000:2.0:1789575722.645318:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789575722.645328:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789575722.646487:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392000:12345-0@lo:501:mount.lustre.0 Request processed in 479us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575722.646502:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789575722.646686:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789575722.646733:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789575722.646790:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.646924:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392128 00000100:00100000:0.0:1789575722.646931:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392128 00000100:00100000:0.0:1789575722.646974:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789575722.646984:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575722.647617:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392128:12345-0@lo:503:mount.lustre.0 Request processed in 632us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.647625:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789575722.647943:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690b95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.647966:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789575722.649112:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789575722.649521:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575722.649609:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.649700:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690b95b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575722.649745:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392256 00000100:00100000:0.0:1789575722.649753:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392256 00000100:00100000:0.0:1789575722.649913:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789575722.649926:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575722.650465:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392256:12345-0@lo:502:mount.lustre.0 Request processed in 540us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.650482:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789575722.650594:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789575722.650863:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789575722.650914:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789575722.650943:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789575722.650985:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789575722.651040:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789575722.651076:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789575722.651123:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789575722.651174:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789575722.651224:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789575722.651277:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575722.651345:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.651887:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.652083:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392384 00000100:00100000:3.0:1789575722.652092:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392384 00000100:00100000:3.0:1789575722.652150:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789575722.652160:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575722.652439:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392384:12345-0@lo:502:mount.lustre.0 Request processed in 280us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.652447:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789575722.652740:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789575722.652859:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789575722.652872:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789575722.654194:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789575722.654206:0:15706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789575722.654214:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789575722.654216:0:15706:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789575722.654222:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789575722.654238:0:15706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e96879b99c0) 00000020:00000080:1.0:1789575722.654506:0:15706:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789575722.654515:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789575722.654585:0:15706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9584e47000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789575722.654594:0:15706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789575722.654601:0:15706:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc45cc82a223843b8 00010000:00010000:1.0:1789575722.664780:0:15706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789575722.665747:0:15706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789575722.668621:0:15706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789575722.675443:0:15706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789575722.675456:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.675463:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.675465:0:15706:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789575722.675469:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575722.675474:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.675476:0:15706:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789575722.675480:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789575722.675482:0:15706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789575722.675484:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.675487:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.675488:0:15706:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789575722.675491:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575722.675494:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.675495:0:15706:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789575722.675498:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789575722.675568:0:15706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.675571:0:15706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.675573:0:15706:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789575722.675577:0:15706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789575722.678735:0:15705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789575722.678781:0:15705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789575722.678814:0:15705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843aa expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.678828:0:15705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96813d1000/0xc45cc82a223843a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843aa expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575722.678836:0:15705:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9584e47000 from 1 10000000:01000000:1.0:1789575722.678839:0:15705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789575722.678885:0:15705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.678893:0:15705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.678904:0:15705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575722.678929:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789575722.679001:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.679049:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.680245:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392512 00000100:00100000:3.0:1789575722.680274:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392512 00000100:00100000:3.0:1789575722.680337:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789575722.680347:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+17:15705:x1876505699392512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789575722.680363:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575722.680413:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223843bf expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.680440:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.680451:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.680459:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96813d1200, rc 0) 00000100:00100000:3.0:1789575722.680517:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392512:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.680524:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789575722.681461:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789575722.681481:0:15705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.681492:0:15705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789575722.682029:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789575722.683118:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789575722.687086:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789575722.687954:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789575722.688037:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789575722.688047:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789575722.688159:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575722.688226:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.688467:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575722.688879:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392640 00000100:00100000:2.0:1789575722.688888:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392640 00000100:00100000:2.0:1789575722.688978:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789575722.688988:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789575722.689635:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392640:12345-0@lo:501:mount.lustre.0 Request processed in 646us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575722.689645:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789575722.690486:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789575722.690540:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789575722.690597:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.690640:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575722.690688:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392768 00000100:00100000:2.0:1789575722.690695:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392768 00000100:00100000:2.0:1789575722.690751:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789575722.690760:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789575722.691068:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392768:12345-0@lo:503:mount.lustre.0 Request processed in 309us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575722.691076:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789575722.691282:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392768:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789575722.691781:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789575722.691869:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575722.691916:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.691941:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.692007:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699392896 00000100:00100000:3.0:1789575722.692013:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699392896 00000100:00100000:3.0:1789575722.692047:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789575722.692057:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575722.692259:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699392896:12345-0@lo:502:mount.lustre.0 Request processed in 204us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.692267:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789575722.692508:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699392896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789575722.692729:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789575722.692780:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789575722.692848:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789575722.692905:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789575722.692941:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789575722.692987:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789575722.693021:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789575722.693053:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789575722.693080:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789575722.693123:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.693292:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.694616:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393024 00000100:00100000:3.0:1789575722.694631:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393024 00000100:00100000:3.0:1789575722.694700:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789575722.694711:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699393024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575722.695119:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699393024:12345-0@lo:502:mount.lustre.0 Request processed in 408us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.695138:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789575722.695734:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789575722.696089:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789575722.696107:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789575722.697912:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575722.697928:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.697931:0:15710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789575722.697939:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9584e47000 00000020:00000080:0.0:1789575722.697942:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789575722.697951:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.697954:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.697956:0:15710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789575722.697958:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575722.697961:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.697962:0:15710:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789575722.697965:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9584e47000 00000020:00000080:0.0:1789575722.697968:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789575722.698081:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.698087:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.698089:0:15710:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789575722.698092:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789575722.698095:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.698096:0:15710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789575722.698099:0:15710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9584e47000 00000020:00000080:0.0:1789575722.698101:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789575722.703836:0:15710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789575722.703852:0:15710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789575722.703855:0:15710:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789575722.703859:0:15710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789575722.711190:0:15705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789575722.711516:0:15705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789575722.711546:0:15705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.711561:0:15705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575722.711638:0:15705:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789575722.711642:0:15705:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9584e47000 10000000:01000000:2.0:1789575722.711645:0:15705:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9584e47000 10000000:01000000:2.0:1789575722.711650:0:15705:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789575722.711657:0:15705:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e9584e47000 from 1 10000000:01000000:2.0:1789575722.711660:0:15705:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789575722.711702:0:15705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.711712:0:15705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.711725:0:15705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575722.711760:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789575722.711843:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575722.711895:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393152 00000100:00100000:2.0:1789575722.711904:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393152 00000100:00100000:2.0:1789575722.711962:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789575722.711973:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699393152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789575722.711986:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575722.712000:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a223843d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223843cd expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.712024:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a223843d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223843cd expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.712036:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef9e00/0xc45cc82a223843d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223843cd expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.712045:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9e00, rc 0) 00000100:00100000:2.0:1789575722.712081:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393152:12345-0@lo:101:mount.lustre.0 Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575722.712088:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789575722.712147:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789575722.712507:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789575722.712530:0:15705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843d4 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575722.712540:0:15705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223843d4 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575722.713888:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789575722.715086:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575722.717018:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789575722.717086:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789575722.718534:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789575722.718727:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789575722.718765:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789575722.718831:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789575722.718868:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789575722.718899:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789575722.718944:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789575722.718979:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789575722.719014:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789575722.719059:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789575722.719088:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789575722.719113:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789575722.723788:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789575722.723874:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789575722.723907:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789575722.724013:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789575722.724054:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789575722.724087:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789575722.724129:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789575722.724165:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789575722.724200:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789575722.724277:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789575722.726862:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789575722.726907:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789575722.726987:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789575722.727027:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789575722.727061:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789575722.728195:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789575722.729634:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789575722.729686:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789575722.729721:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789575722.729863:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789575722.729906:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789575722.729956:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789575722.729995:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789575722.730098:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789575722.730107:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789575722.732781:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789575722.733539:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575722.739345:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575722.743418:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393280 00000100:00100000:0.0:1789575722.743443:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393280 00000100:00100000:0.0:1789575722.743508:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789575722.743521:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575722.743873:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393280:12345-0@lo:501:mount.lustre.0 Request processed in 355us (10337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.743882:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789575722.744645:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789575722.744707:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789575722.744776:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.744832:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9691984a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.747645:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393408 00000100:00100000:3.0:1789575722.747662:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393408 00000100:00100000:3.0:1789575722.747723:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789575722.747734:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789575722.748629:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393408:12345-0@lo:503:mount.lustre.0 Request processed in 893us (3849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.748641:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789575722.750029:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789575722.751671:0:15705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789575722.751799:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789575722.751941:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575722.752015:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9688fb0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789575722.752137:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393536 00000100:00100000:0.0:1789575722.752147:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393536 00000100:00100000:0.0:1789575722.752256:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789575722.752266:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789575722.752873:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393536:12345-0@lo:502:mount.lustre.0 Request processed in 604us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.752883:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789575722.753019:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789575722.753355:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789575722.753435:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789575722.753469:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789575722.753522:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789575722.753560:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789575722.753611:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789575722.753648:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789575722.753680:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789575722.753760:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789575722.753803:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789575722.753864:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789575722.753916:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789575722.753953:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789575722.753987:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789575722.754034:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789575722.754065:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789575722.754093:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789575722.754132:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789575722.754162:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789575722.754189:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789575722.754230:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789575722.754264:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789575722.754299:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789575722.754350:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789575722.754435:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789575722.754472:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789575722.754527:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789575722.754562:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789575722.754594:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789575722.754637:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789575722.754666:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789575722.754692:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789575722.754718:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789575722.754775:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789575722.754828:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789575722.754881:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789575722.754915:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789575722.754948:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789575722.755002:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789575722.755039:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789575722.755101:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789575722.755198:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575722.756019:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9690ae8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789575722.756060:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393664 00000100:00100000:3.0:1789575722.756072:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393664 00000100:00100000:3.0:1789575722.756126:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789575722.756139:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789575722.756648:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699393664:12345-0@lo:502:mount.lustre.0 Request processed in 509us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575722.756656:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789575722.760477:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699393664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789575722.760736:0:15705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789575722.760759:0:15705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789575722.763186:0:15715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789575722.763236:0:15715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e9587680000) 00000020:00000080:2.0:1789575722.763266:0:15715:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789575722.763351:0:15715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9584e47000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789575722.763357:0:15715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9584e47000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789575722.763361:0:15715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9584e47000 3 00010000:00080000:2.0:1789575722.763436:0:15715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e96bcdb7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789575722.765152:0:15715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789575722.765433:0:15715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789575722.765484:0:15715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789575722.765509:0:15715:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc45cc82a223843e2 00000100:00080000:2.0:1789575722.765526:0:15715:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789575722.765539:0:15715:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e96bcdb7000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789575722.765590:0:15715:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bbd05f80 x1876505699393792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575722.772303:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699393792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789575722.772434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789575722.772549:0:15715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789575722.773347:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789575722.773352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789575722.773356:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789575722.773362:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:0.0:1789575722.773366:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789575722.773407:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789575722.773449:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e96bc9c7800 x1876505699394048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789575722.773514:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699394176:0@lo:400:kworker.0 00000100:00100000:0.0:1789575722.773574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.773608:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789575722.773614:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699393920:0@lo:400:kworker.0 00000100:00100000:0.0:1789575722.773647:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.773681:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699394048:0@lo:8:kworker.0 00000100:00100000:0.0:1789575722.773703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.773730:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699394304:0@lo:400:kworker.0 00000100:00100000:0.0:1789575722.773756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575722.773800:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393792 00000100:00100000:0.0:1789575722.773821:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393792 00000100:00100000:0.0:1789575722.773853:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394176 00000100:00100000:0.0:1789575722.773856:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394176 00000100:00100000:0.0:1789575722.773881:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394304 00000100:00100000:0.0:1789575722.773884:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394304 00000100:00100000:0.0:1789575722.773919:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575722.773928:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699394176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575722.773998:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876505699394176:12345-0@lo:400:kworker.0 Request processed in 70us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.774006:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789575722.774026:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789575722.774032:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699394304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575722.774063:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699394304:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.774081:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789575722.774095:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575722.774099:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876505699393792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789575722.774122:0:14301:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1789575722.774161:0:14301:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc45cc82a223843e9 00000004:00100000:0.0:1789575722.774178:0:14301:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789575722.774209:0:14301:0:(import.c:65:import_set_state_nolock()) ffff8e9587754800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575722.774397:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699393920 00000100:00100000:1.0:1789575722.774403:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699393920 00000100:00100000:1.0:1789575722.774461:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394048 00000100:00100000:1.0:1789575722.774465:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394048 00000100:00100000:1.0:1789575722.774476:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575722.774484:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699393920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575722.774529:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699393920:12345-0@lo:400:kworker.0 Request processed in 47us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575722.774536:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575722.774552:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575722.774556:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699394048:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789575722.774600:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876505699394048:12345-0@lo:8:kworker.0 Request processed in 43us (895us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789575722.774607:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789575722.774649:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789575722.774656:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789575722.774661:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789575722.774664:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699394048:0@lo:8:kworker.0 00000100:00100000:0.0:1789575722.776749:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876505699393792:12345-0@lo:38:llog_process_th.0 Request processed in 2638us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575722.776762:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789575722.776799:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575722.776816:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575722.776852:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699393920:0@lo:400:kworker.0 00010000:00080000:0.0:1789575722.776869:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7100 x1876505699394176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575722.776880:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876505699394176:0@lo:400:kworker.0 00010000:00080000:0.0:1789575722.776915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bc9c7480 x1876505699394304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789575722.776924:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699394304:0@lo:400:kworker.0 00010000:00080000:2.0:1789575722.777586:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e96bbd05f80 x1876505699393792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789575732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575722.777595:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789575722.777604:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789575722.777613:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789575722.777618:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789575722.777621:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e96bcdb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789575722.777627:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876505699393792:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789575722.777853:0:15715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789575722.778720:0:15705:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789575722.778762:0:15705:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789575722.778791:0:15705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843d4 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575722.778814:0:15705:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef8c00/0xc45cc82a223843cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843d4 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789575722.778887:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789575722.778890:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789575722.778896:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575722.778897:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575722.778898:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575722.778899:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575722.778901:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575722.778902:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575722.778903:0:15705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575722.778908:0:15705:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789575722.778911:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789575722.778912:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789575722.778913:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789575722.778914:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789575722.778915:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789575722.778915:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789575722.778916:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789575722.778917:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789575722.778918:0:15705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789575722.778947:0:15705:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789575722.778973:0:15705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699394432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789575722.779065:0:15705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575722.779116:0:15705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699d77840 going to sleep for 11 seconds 00000100:00100000:2.0:1789575722.779179:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394432 00000100:00100000:2.0:1789575722.779189:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394432 00000100:00100000:2.0:1789575722.779325:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789575722.779337:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+19:15705:x1876505699394432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789575722.779408:0:14294:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789575722.779430:0:14294:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789575722.813828:0:14294:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789575722.813839:0:14294:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789575722.813953:0:14316:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789575722.813958:0:14316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789575722.813981:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.814000:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223842bc expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.814022:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.814063:0:14316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.814078:0:14316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 19 pid: 14295 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575722.814093:0:14316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699394560:0@lo:104: 00000100:00100000:0.0:1789575722.814183:0:14316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.814322:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394560 00000100:00100000:1.0:1789575722.814331:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394560 00000100:00100000:1.0:1789575722.814411:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575722.814423:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699394560:12345-0@lo:104: 00010000:00010000:1.0:1789575722.814438:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814490:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789575722.814497:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:14316:x1876505699394560:12345-0@lo:104: Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575722.814504:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789575722.814530:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575722.814537:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814558:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:1.0:1789575722.814562:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814570:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789575722.814578:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789575722.814585:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789575722.814620:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814628:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789575722.814650:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814657:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d0a00/0xc45cc82a223842bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223842c3 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814673:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575722.814675:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575722.814677:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575722.814695:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699394688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575722.814723:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575722.814754:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394688 00000100:00100000:1.0:1789575722.814758:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394688 00010000:00010000:1.0:1789575722.814775:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 20 pid: 14295 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575722.814803:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789575722.814823:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75adfecc-338c-4204-8932-8d3be75fd826+20:3307:x1876505699394688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789575722.814834:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575722.814839:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 20 pid: 14295 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814850:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 20 pid: 14295 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814866:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814875:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789575722.814889:0:14287:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001660324s 00010000:00010000:1.0:1789575722.814894:0:14287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814901:0:14287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814908:0:14287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814915:0:14287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814920:0:14287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2077200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575722.814931:0:14287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814939:0:14287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814949:0:14287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575722.814960:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575722.814990:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75adfecc-338c-4204-8932-8d3be75fd826+20:3307:x1876505699394688:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575722.814996:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789575722.815080:0:14316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc6583c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789575722.815104:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223842c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223842bc expref: 19 pid: 14295 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575722.815115:0:14316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14316:1876505699394560:0@lo:104: 00010000:00010000:0.0:1789575722.815135:0:14316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.815144:0:14316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.815149:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575722.815156:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2077200/0xc45cc82a223843f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575722.815216:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699394688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575722.840188:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:15705:x1876505699394432:12345-0@lo:253:mount.lustre.0 Request processed in 60841us (61110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575722.840204:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789575722.840566:0:15705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:75adfecc-338c-4204-8932-8d3be75fd826:15705:1876505699394432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789575722.840588:0:15705:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789575722.840592:0:15705:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789575722.840594:0:15705:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789575722.840596:0:15705:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789575722.840597:0:15705:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789575722.840598:0:15705:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789575722.840600:0:15705:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789575722.840601:0:15705:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789575722.840603:0:15705:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789575722.840605:0:15705:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789575722.840622:0:15705:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789575722.847746:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575722.847928:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575722.848091:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575722.848920:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789575722.849092:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789575722.849347:0:15705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789575722.850561:0:15705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789575722.945069:0:15705:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789575722.945082:0:15705:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789575722.945194:0:15705:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789575722.945272:0:15705:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789575722.945288:0:15705:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789575722.945323:0:15705:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789575723.180409:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575724.200803:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789575724.776852:0:14297:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789575724.776864:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e96bd0ce000 from 8 10000000:01000000:2.0:1789575724.776870:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789575724.776935:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575724.776951:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575724.776965:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575724.777009:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699394816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789575724.777108:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575724.777187:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9684d72480 going to sleep for 11 seconds 00000100:00100000:1.0:1789575724.777259:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394816 00000100:00100000:1.0:1789575724.777278:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394816 00000100:00100000:1.0:1789575724.777350:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789575724.777365:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699394816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575724.777402:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575724.777419:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87200/0xc45cc82a223843fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a223843f7 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575724.777443:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87200/0xc45cc82a223843fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a223843f7 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575724.777476:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87200/0xc45cc82a223843fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223843f7 expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575724.777485:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87200, rc 0) 00000100:00100000:1.0:1789575724.777531:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699394816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575724.777538:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789575724.777592:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699394816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575724.777606:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843fe expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575724.777761:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a223843fe expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575724.777851:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699394944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789575724.777898:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575724.777933:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575724.778668:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699394944 00000100:00100000:2.0:1789575724.778676:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699394944 00000100:00100000:2.0:1789575724.778727:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789575724.778738:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699394944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789575724.778761:0:14292:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789575724.778782:0:14292:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789575724.778797:0:14292:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789575724.778912:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699394944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575724.778920:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789575724.781525:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699394944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789575724.781611:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789575724.781620:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843fe expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575724.781631:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e9687ef9200/0xc45cc82a223843f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a223843fe expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575725.227633:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575725.480792:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699395072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575725.480870:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575725.480992:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395072 00000100:00100000:2.0:1789575725.481000:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395072 00000100:00100000:2.0:1789575725.481059:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789575725.481070:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699395072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575725.481105:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575725.481156:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699395072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575725.481163:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789575725.481221:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789575725.481258:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699395072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789575726.252281:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575727.275505:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789575728.043183:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789575728.043191:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789575728.043195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789575728.043213:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e9686553800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789575728.043246:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9585826d80 x1876505699395456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789575728.043353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699395712:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043455:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.043512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789575728.043518:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699395200:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.043569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699395840:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043593:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.043619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699395328:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.043667:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575728.043672:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699395584:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.043730:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395712 00000100:00100000:1.0:1789575728.043740:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395712 00000100:00100000:1.0:1789575728.043815:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395840 00000100:00100000:1.0:1789575728.043819:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395840 00000100:00100000:1.0:1789575728.043834:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395584 00000100:00100000:1.0:1789575728.043836:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395584 00000100:00100000:1.0:1789575728.043851:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789575728.043860:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699395712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043922:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699395712:12345-0@lo:400:kworker.0 Request processed in 62us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575728.043929:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789575728.043944:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789575728.043950:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699395840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.043989:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699395840:12345-0@lo:400:kworker.0 Request processed in 40us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575728.043996:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789575728.044008:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789575728.044013:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699395584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.044042:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699395584:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575728.044048:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789575728.044070:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395328 00000100:00100000:1.0:1789575728.044074:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395328 00000100:00100000:1.0:1789575728.044102:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789575728.044108:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699395328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.044138:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699395328:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575728.044143:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789575728.044180:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585826680 x1876505699395584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575728.044193:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699395584:0@lo:400:kworker.0 00000100:00100000:1.0:1789575728.044203:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699395328:0@lo:400:kworker.0 00010000:00080000:1.0:1789575728.044230:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585824000 x1876505699395840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575728.044239:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699395840:0@lo:400:kworker.0 00010000:00080000:1.0:1789575728.044249:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585825880 x1876505699395712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575728.044271:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699395712:0@lo:400:kworker.0 00000100:00080000:0.0:1789575728.045065:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575728.045072:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575728.045401:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699395456:0@lo:8:kworker.0 00000100:00100000:2.0:1789575728.045977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575728.046039:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395200 00000100:00100000:2.0:1789575728.046046:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395200 00000100:00100000:2.0:1789575728.046101:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789575728.046121:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c1290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699395200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575728.046173:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c1290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699395200:12345-0@lo:400:kworker.0 Request processed in 54us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575728.046181:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789575728.046329:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395456 00000100:00100000:0.0:1789575728.046334:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395456 00000100:00100000:0.0:1789575728.046359:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575728.046364:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876505699395456:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789575728.046421:0:14986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1789575728.046456:0:14986:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc45cc82a22384405 00002000:00100000:0.0:1789575728.046469:0:14986:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e9587752000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789575728.046473:0:14986:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789575728.046476:0:14986:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789575728.046837:0:14986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789575728.046874:0:14986:0:(import.c:65:import_set_state_nolock()) ffff8e9587755800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789575728.046942:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876505699395456:12345-0@lo:8:kworker.0 Request processed in 576us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575728.046950:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789575728.047210:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699395200:0@lo:400:kworker.0 00010000:00080000:2.0:1789575728.047346:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585826d80 x1876505699395456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789575753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789575728.047365:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789575728.047389:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789575728.047578:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789575728.047583:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8e9686553800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789575728.047601:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789575728.047608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876505699395456:0@lo:8:kworker.0 00000004:00080000:2.0:1789575728.047674:0:14325:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789575728.047694:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14325:1876505699396096:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789575728.047734:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575728.047770:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e969114f300 going to sleep for 11 seconds 00000004:00080000:2.0:1789575728.049580:0:14324:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789575728.050326:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396096 00000100:00100000:0.0:1789575728.050340:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396096 00000004:00080000:2.0:1789575728.051170:0:14324:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 540137796833ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789575728.051198:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789575728.051220:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699395968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789575728.051340:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789575728.051354:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14325:x1876505699396096:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789575728.054014:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575728.054125:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699395968 00000100:00100000:2.0:1789575728.054135:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699395968 00000100:00100000:2.0:1789575728.054197:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789575728.054207:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876505699395968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575728.055978:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575728.056076:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876505699395968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1867us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575728.056086:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789575728.056157:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e96bbd04000 x1876505699395968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789575744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789575728.056183:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699395968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789575728.056397:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789575728.058483:0:14987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789575728.058495:0:14987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789575728.058500:0:14987:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789575728.090216:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789575728.090645:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575728.090667:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=540s v=(0 0) 00010000:00010000:0.0:1789575728.090673:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575728.090679:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575728.090697:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575728.090709:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575728.090716:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.091603:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789575728.093137:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575728.093149:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.093163:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96c2076000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.093169:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.093182:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.093210:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.093218:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007abbc84f/0xc45cc82a2238440c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.093253:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.093255:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.093257:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.095153:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.095166:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.095181:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.095185:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.095191:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.095205:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.095215:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.095222:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.096457:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575728.097111:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.097119:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.097132:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.097135:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.097140:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.097153:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.097162:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.097169:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108332:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789575728.108348:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108363:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.108394:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108426:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108453:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108461:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7ab0bec/0xc45cc82a22384413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108488:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575728.108492:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108499:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.108502:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108509:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108520:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.108528:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.108536:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.108539:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.108796:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789575728.108806:0:14987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238441a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.115363:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.115601:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.115612:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115869:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.115875:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.115882:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115900:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115913:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115922:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115945:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.115958:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.115964:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115971:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.115976:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.115985:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.116012:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.116019:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.116042:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.116044:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.116045:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.128465:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.128481:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.128500:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.128505:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.128512:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.128527:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.128539:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.128547:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.128587:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575728.129152:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.129158:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129167:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.129169:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.129174:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129183:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129190:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129197:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129212:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789575728.129224:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575728.129230:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129237:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.129248:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129258:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129275:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129283:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9527e1b/0xc45cc82a22384428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129301:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.129304:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129310:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.129313:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129320:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129330:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129336:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d01699/0xc45cc82a2238442f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.129357:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.129359:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.129361:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.132917:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.139143:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.139166:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139191:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.139197:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.139205:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139221:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139243:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139253:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139273:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.139292:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.139298:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139325:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.139330:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139341:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139362:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139398:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f41f372/0xc45cc82a22384436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.139426:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.139428:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.139430:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.140075:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.140082:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140092:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.140096:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.140101:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140111:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140128:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140135:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140167:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789575728.140628:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.140635:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140643:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.140646:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.140650:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140659:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140666:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140673:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140699:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789575728.140712:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575728.140717:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140724:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.140727:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140736:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140750:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140769:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fdf6b08/0xc45cc82a2238443d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140785:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.140788:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140794:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.140798:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140817:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140828:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140835:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9a1817f/0xc45cc82a22384444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.140849:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.140851:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.140852:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789575728.141312:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.141319:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141328:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.141332:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575728.141336:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141346:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141355:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141400:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141417:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.141429:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.141433:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141439:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.141442:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141450:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141462:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141468:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f641541/0xc45cc82a2238444b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.141484:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.141485:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.141487:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.143717:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789575728.152612:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789575728.152903:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.152914:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.152935:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.152941:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.152948:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.152965:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.152976:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.152985:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.153016:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.153079:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.153097:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.153109:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.153114:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.153125:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.153148:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.153156:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be7a1db7/0xc45cc82a22384452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.153179:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.153181:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.153182:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.155251:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.155263:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.155280:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.155284:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.155290:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.155312:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.155323:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.155331:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.155363:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789575728.156959:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.156969:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.156984:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.156988:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.156994:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157007:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157016:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157036:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157054:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789575728.157931:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.157939:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157953:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.157957:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.157962:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157973:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157982:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.157990:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158000:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789575728.158889:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.158897:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158919:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.158923:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.158929:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158941:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158951:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158959:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.158970:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789575728.159840:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.159849:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.159862:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.159865:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.159870:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.159883:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.159906:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.159915:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.159928:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789575728.160992:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.161003:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.161014:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.161019:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.161023:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.161036:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.161045:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.161053:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.161199:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789575728.163177:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789575728.163195:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163213:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163218:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163245:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163275:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163283:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7803c77/0xc45cc82a22384459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163316:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789575728.163321:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163328:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163331:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163338:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163348:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163356:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001095db04/0xc45cc82a22384460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163412:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789575728.163426:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163434:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163437:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163446:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163457:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163465:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919b5533/0xc45cc82a22384467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163479:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789575728.163483:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163490:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0a00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163493:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163512:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163524:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163532:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019e16a67/0xc45cc82a2238446e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163546:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575728.163551:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163559:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163562:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163570:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163580:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163587:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000618d6005/0xc45cc82a22384475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163612:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.163615:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163622:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.163625:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163633:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163644:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163652:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000622bff98/0xc45cc82a2238447c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.163664:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.163666:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.163669:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.163677:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.163949:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.163961:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.163976:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.163983:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.163990:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.164006:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.164018:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.164028:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.164059:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.164116:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.164122:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.164130:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d0c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.164141:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.164150:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.164164:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.164172:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000886b29a/0xc45cc82a22384483 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.164190:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.164193:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.164196:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.165717:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.165729:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.165748:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.165772:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.165779:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.165796:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.165807:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.165815:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.165840:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789575728.166402:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.166409:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166420:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.166423:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.166427:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166438:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166446:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166460:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166474:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789575728.166945:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.166951:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166961:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.166965:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.166969:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166979:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166988:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.166996:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167005:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789575728.167541:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.167549:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167565:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.167569:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.167574:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167586:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167595:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167603:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.167612:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789575728.167940:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789575728.167950:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.167962:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.167967:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.167979:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168004:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168021:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923c7573/0xc45cc82a2238448a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168043:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789575728.168048:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168056:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2c00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.168060:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789575728.168066:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789575728.168069:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168073:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168088:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789575728.168090:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168091:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.168100:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168105:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036542560/0xc45cc82a22384491 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168118:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168126:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575728.168130:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168146:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3800 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.168160:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168163:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168178:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168183:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168186:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789575728.168200:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168207:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f632c96a/0xc45cc82a22384498 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168224:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575728.168228:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168235:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.168240:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168247:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168259:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168266:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863adc68/0xc45cc82a2238449f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168292:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.168296:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168302:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.168305:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168314:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168325:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168332:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aecbedd1/0xc45cc82a223844a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168352:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.168354:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.168356:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.168367:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.168600:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.168604:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168610:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.168612:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.168615:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168622:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168630:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168638:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.168660:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789575728.168698:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575728.168705:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168714:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575728.168725:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168735:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168747:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168767:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c840e11/0xc45cc82a223844ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575728.168792:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.168794:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575728.168796:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.171829:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.171851:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.171872:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.171878:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.171886:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.171906:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.171918:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.171926:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.171948:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789575728.174088:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.174101:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.174118:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.174872:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.174880:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.174897:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.174908:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.174917:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.174938:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789575728.175447:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789575728.175457:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175467:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.175471:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175481:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175499:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175506:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0a8e679/0xc45cc82a223844b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175527:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575728.175531:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175537:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3200 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.175541:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175556:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175567:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175574:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef7330f/0xc45cc82a223844bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.175589:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.175591:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.175593:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789575728.175872:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789575728.175880:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.175890:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789575728.175894:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575728.175898:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.175909:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.175916:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.175929:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575728.175953:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789575728.176265:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789575728.176270:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.176278:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575728.176281:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.176289:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.176301:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.176320:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b91c6a4d/0xc45cc82a223844c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575728.176335:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.176336:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575728.176338:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789575728.176629:0:14987:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789575728.176731:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14325:x1876505699396096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 125378us (128993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575728.176741:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789575728.184928:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575728.185019:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14325:1876505699396096:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789575728.185041:0:14325:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789575728.185096:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14325:1876505699396224:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789575728.185170:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575728.185499:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396224 00000100:00100000:1.0:1789575728.185509:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396224 00000100:00100000:1.0:1789575728.185570:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789575728.185581:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14325:x1876505699396224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789575728.185629:0:14985:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789575728.185881:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968652e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575728.198004:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14325:x1876505699396224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12411us (12820us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789575728.198024:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789575728.204266:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14325:1876505699396224:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789575728.204296:0:14325:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1789575728.296691:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575729.323121:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789575730.346974:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575730.603552:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699396352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575730.603646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575730.607263:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396352 00000100:00100000:2.0:1789575730.607289:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396352 00000100:00100000:2.0:1789575730.607544:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575730.607564:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699396352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575730.607636:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575730.607753:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699396352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575730.607760:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575730.607838:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699396352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575730.609187:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789575730.920527:0:16060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789575731.370343:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575732.394882:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789575732.843594:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789575733.163436:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789575733.163466:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699396480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575733.163565:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575733.163656:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396480 00000100:00100000:2.0:1789575733.163667:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396480 00000100:00100000:2.0:1789575733.163748:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789575733.163763:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876505699396480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575733.163811:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575733.164266:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876505699396480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 508us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575733.164275:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789575733.164304:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575733.164351:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699396480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789575733.165412:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699396992:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165469:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575733.165502:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789575733.165507:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699396608:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165535:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575733.165568:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699397120:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165591:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575733.165620:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699396736:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165649:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575733.165682:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789575733.165688:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699396864:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575733.165757:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396992 00000100:00100000:1.0:1789575733.165768:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396992 00000100:00100000:1.0:1789575733.165825:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397120 00000100:00100000:1.0:1789575733.165829:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397120 00000100:00100000:1.0:1789575733.165845:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396864 00000100:00100000:1.0:1789575733.165848:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396864 00000100:00100000:1.0:1789575733.165866:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789575733.165875:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699396992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165930:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699396992:12345-0@lo:400:kworker.0 Request processed in 56us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575733.165937:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789575733.165952:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575733.165959:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.165985:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699397120:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575733.165991:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789575733.166001:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575733.166006:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699396864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.166048:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699396864:12345-0@lo:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575733.166055:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789575733.166108:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585824e00 x1876505699396864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575733.166123:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699396864:0@lo:400:kworker.0 00010000:00080000:1.0:1789575733.166165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585825c00 x1876505699397120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575733.166174:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699397120:0@lo:400:kworker.0 00010000:00080000:1.0:1789575733.166184:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9585826680 x1876505699396992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789575749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789575733.166193:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699396992:0@lo:400:kworker.0 00000100:00100000:2.0:1789575733.166528:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396736 00000100:00100000:2.0:1789575733.166533:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396736 00000100:00100000:2.0:1789575733.166566:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789575733.166574:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699396736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575733.166619:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876505699396736:12345-0@lo:400:kworker.0 Request processed in 46us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575733.166635:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789575733.166653:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575733.166658:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575733.166677:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876505699396736:0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.168152:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699396608 00000100:00100000:1.0:1789575733.168165:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699396608 00000100:00100000:1.0:1789575733.168226:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789575733.168235:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699396608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575733.168311:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699396608:12345-0@lo:400:kworker.0 Request processed in 77us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575733.168317:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789575733.168367:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699396608:0@lo:400:kworker.0 00000001:00100000:3.0:1789575733.357621:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789575733.357645:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1789575733.417772:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575734.031528:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575734.032127:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326016 00000100:00100000:2.0:1789575734.032139:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326016 00000100:00100000:2.0:1789575734.032236:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789575734.032246:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1876505676326016:12345-192.168.202.32@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789575734.032285:0:14294:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5eb10d71-3a0e-4817-a234-1e8fbc839dd4@192.168.202.32@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:2.0:1789575734.032325:0:14294:0:(genops.c:1384:class_connect()) connect: client 5eb10d71-3a0e-4817-a234-1e8fbc839dd4, cookie 0xc45cc82a223844c9 00000100:00080000:3.0:1789575734.033207:0:14294:0:(import.c:65:import_set_state_nolock()) ffff8e96878e7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575734.033289:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+5:2354:x1876505676326016:12345-192.168.202.32@tcp:250:mount.lustre.0 Request processed in 1041us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.033297:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:3.0:1789575734.048173:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575734.048716:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326144 00000100:00100000:2.0:1789575734.048732:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326144 00000100:00100000:0.0:1789575734.048861:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:0.0:1789575734.048873:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+5:13735:x1876505676326144:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789575734.048894:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575734.048916:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223844d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5dab expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.048952:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223844d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5dab expref: 6 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.048966:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2077c00/0xc45cc82a223844d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5dab expref: 6 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.048977:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077c00, rc 0) 00000100:00100000:0.0:1789575734.049068:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+6:13735:x1876505676326144:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 196us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.049083:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:0.0:1789575734.053933:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575734.054076:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326272 00000100:00100000:3.0:1789575734.054091:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326272 00000100:00100000:3.0:1789575734.054173:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:3.0:1789575734.054187:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+6:13735:x1876505676326272:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789575734.055823:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+6:13735:x1876505676326272:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 1624us (1894us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789575734.055855:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:2.0:1789575734.061824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.062211:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326400 00000100:00100000:1.0:1789575734.062225:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326400 00000100:00100000:1.0:1789575734.062292:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789575734.062305:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+6:13735:x1876505676326400:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789575734.062604:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575734.062627:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe87c00/0xc45cc82a223844d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5db2 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.062660:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe87c00/0xc45cc82a223844d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5db2 expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.062694:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe87c00/0xc45cc82a223844d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5db2 expref: 7 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.062716:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87c00, rc 0) 00000100:00100000:1.0:1789575734.062864:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+7:13735:x1876505676326400:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 562us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.062873:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:0.0:1789575734.076357:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575734.076438:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326528 00000100:00100000:3.0:1789575734.076450:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326528 00000100:00100000:3.0:1789575734.076513:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:3.0:1789575734.076525:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+7:13735:x1876505676326528:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789575734.076902:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13735:x1876505676326528:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 376us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.076912:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:2.0:1789575734.079902:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.079994:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326656 00000100:00100000:0.0:1789575734.080005:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326656 00000100:00100000:0.0:1789575734.080167:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:0.0:1789575734.080186:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13735:x1876505676326656:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789575734.080524:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13735:x1876505676326656:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 346us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.080534:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:2.0:1789575734.090990:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575734.092150:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326784 00000100:00100000:3.0:1789575734.092166:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326784 00000100:00100000:3.0:1789575734.092424:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:3.0:1789575734.092433:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13754:x1876505676326784:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789575734.092800:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13754:x1876505676326784:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 367us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.092809:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:3.0:1789575734.113526:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.113787:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676326912 00000100:00100000:0.0:1789575734.113818:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676326912 00000100:00100000:0.0:1789575734.113900:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789575734.113908:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13754:x1876505676326912:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789575734.114227:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13754:x1876505676326912:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 318us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.114236:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:2.0:1789575734.120671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.122275:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327040 00000100:00100000:1.0:1789575734.122297:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327040 00000100:00100000:1.0:1789575734.127667:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:1.0:1789575734.127711:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+8:13735:x1876505676327040:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789575734.127731:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575734.127753:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86600/0xc45cc82a223844de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ddc expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.127786:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86600/0xc45cc82a223844de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ddc expref: 9 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.127798:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86600/0xc45cc82a223844de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ddc expref: 9 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575734.127807:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86600, rc 0) 00000100:00100000:1.0:1789575734.127891:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+9:13735:x1876505676327040:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 206us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.127898:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:2.0:1789575734.132953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.133059:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327168 00000100:00100000:0.0:1789575734.133071:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327168 00000100:00100000:0.0:1789575734.133143:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789575734.133153:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+9:13735:x1876505676327168:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789575734.133192:0:14292:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789575734.133222:0:14292:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789575734.133226:0:14292:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789575734.133229:0:14292:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789575734.133232:0:14292:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789575734.137895:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+9:13735:x1876505676327168:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 4727us (4937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.137914:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:2.0:1789575734.146367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.146792:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327296 00000100:00100000:0.0:1789575734.146809:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327296 00000100:00100000:0.0:1789575734.146934:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789575734.146946:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+9:13735:x1876505676327296:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789575734.146966:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575734.146989:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5de3 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.147038:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 10 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.147091:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 10 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.147111:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076400, rc 0) 00000100:00100000:0.0:1789575734.147193:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13735:x1876505676327296:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 248us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.147201:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:2.0:1789575734.149691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.149836:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327424 00000100:00100000:0.0:1789575734.149846:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327424 00000100:00100000:0.0:1789575734.149899:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:0.0:1789575734.149909:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13735:x1876505676327424:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789575734.150269:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13735:x1876505676327424:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 360us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.150278:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:0.0:1789575734.152708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.152930:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327552 00000100:00100000:1.0:1789575734.152957:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327552 00000100:00100000:1.0:1789575734.153129:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:1.0:1789575734.153142:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13735:x1876505676327552:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789575734.153761:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13735:x1876505676327552:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 618us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.153771:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:2.0:1789575734.156852:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.157135:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327680 00000100:00100000:1.0:1789575734.157146:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327680 00000100:00100000:1.0:1789575734.157202:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:1.0:1789575734.157213:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13755:x1876505676327680:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789575734.157715:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13755:x1876505676327680:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 503us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.157724:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:2.0:1789575734.166548:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.166820:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327808 00000100:00100000:1.0:1789575734.166836:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327808 00000100:00100000:1.0:1789575734.166918:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:1.0:1789575734.166931:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13755:x1876505676327808:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789575734.167229:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13755:x1876505676327808:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 299us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.167238:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:3.0:1789575734.184840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.185313:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676327936 00000100:00100000:1.0:1789575734.185326:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676327936 00000100:00100000:1.0:1789575734.185435:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789575734.185444:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1876505676327936:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789575734.185474:0:14300:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 68701ed1-8a58-4b10-b854-0f15bbb165d2@192.168.202.32@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:1.0:1789575734.185546:0:14300:0:(genops.c:1384:class_connect()) connect: client 68701ed1-8a58-4b10-b854-0f15bbb165d2, cookie 0xc45cc82a223844ec 00000004:00100000:1.0:1789575734.185577:0:14300:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789575734.185584:0:14300:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789575734.236313:0:14300:0:(import.c:65:import_set_state_nolock()) ffff8e9687980800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575734.236440:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2354:x1876505676327936:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 50994us (51608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.236452:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:2.0:1789575734.242576:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575734.243742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.244278:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328192 00000100:00100000:1.0:1789575734.244289:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328192 00000100:00100000:1.0:1789575734.244367:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328064 00000100:00100000:1.0:1789575734.244400:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328064 00000100:00100000:1.0:1789575734.244427:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789575734.244437:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:13735:x1876505676328192:12345-192.168.202.32@tcp:41:mount.lustre.0 00000100:00100000:3.0:1789575734.244458:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575734.244474:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:0:x1876505676328064:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789575734.244492:0:15386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1789575734.244498:0:14302:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789575734.244689:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575734.244795:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:0:x1876505676328064:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 328us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.244801:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789575734.248317:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13735:x1876505676328192:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 3864us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.248335:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:2.0:1789575734.255386:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575734.255793:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328320 00000100:00100000:3.0:1789575734.255807:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328320 00000100:00100000:3.0:1789575734.255893:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575734.255908:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13735:x1876505676328320:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789575734.256028:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13735:x1876505676328320:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 124us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.256034:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789575734.260162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.260614:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328448 00000100:00100000:1.0:1789575734.260628:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328448 00000100:00100000:1.0:1789575734.260692:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789575734.260712:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1876505676328448:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789575734.260756:0:14985:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 68701ed1-8a58-4b10-b854-0f15bbb165d2@192.168.202.32@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:1.0:1789575734.260799:0:14985:0:(genops.c:1384:class_connect()) connect: client 68701ed1-8a58-4b10-b854-0f15bbb165d2, cookie 0xc45cc82a223844f3 00002000:00100000:1.0:1789575734.260814:0:14985:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68701ed1-8a58-4b10-b854-0f15bbb165d2/ffff8e9687982000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789575734.260841:0:14985:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789575734.261195:0:14985:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789575734.261233:0:14985:0:(import.c:65:import_set_state_nolock()) ffff8e9687987800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575734.261316:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2354:x1876505676328448:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 605us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575734.261326:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789575734.268707:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575734.268751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575734.268851:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328704 00000100:00100000:2.0:1789575734.268875:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328704 00000100:00100000:2.0:1789575734.268932:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:2.0:1789575734.268940:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13735:x1876505676328704:12345-192.168.202.32@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789575734.269416:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328576 00000100:00100000:3.0:1789575734.269423:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328576 00000100:00100000:3.0:1789575734.269457:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789575734.269464:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876505676328576:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789575734.269503:0:14987:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 68701ed1-8a58-4b10-b854-0f15bbb165d2@192.168.202.32@tcp t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1789575734.269535:0:14987:0:(genops.c:1384:class_connect()) connect: client 68701ed1-8a58-4b10-b854-0f15bbb165d2, cookie 0xc45cc82a223844fa 00002000:00100000:3.0:1789575734.269547:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68701ed1-8a58-4b10-b854-0f15bbb165d2/ffff8e96878e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575734.269560:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575734.269890:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789575734.269918:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8e96878e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575734.269975:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2354:x1876505676328576:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 512us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.269982:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000004:00080000:2.0:1789575734.271623:0:14303:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2599us 00000004:00200000:3.0:1789575734.319988:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789575734.320126:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13735:x1876505676328704:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 51179us (51367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575734.320141:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00010000:00010000:0.0:1789575734.440635:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575734.539938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575734.540050:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328832 00000100:00100000:0.0:1789575734.540061:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328832 00000100:00100000:0.0:1789575734.540130:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789575734.540141:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13776:x1876505676328832:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:0.0:1789575734.540164:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575734.540196:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077200/0xc45cc82a22384501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e0d expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540269:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540297:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540313:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575734.540353:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575734.540357:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575734.540452:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540482:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077200/0xc45cc82a22384501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e0d expref: 8 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540515:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e0d expref: 7 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575734.540525:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:0.0:1789575734.540528:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575734.540532:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2077a00, rc 0) 00000100:00100000:0.0:1789575734.540587:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:13776:x1876505676328832:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 449us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575734.540595:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00010000:00010000:2.0:1789575735.466591:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575735.721274:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575735.721313:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699397248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575735.721425:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575735.721530:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397248 00000100:00100000:3.0:1789575735.721538:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397248 00000100:00100000:3.0:1789575735.721609:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789575735.721618:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699397248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575735.721637:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575735.721710:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699397248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575735.721717:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789575735.721765:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699397248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789575735.721833:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575736.360343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.360585:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676328960 00000100:00100000:2.0:1789575736.360609:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676328960 00000100:00100000:2.0:1789575736.360719:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789575736.360731:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:13828:x1876505676328960:12345-192.168.202.32@tcp:41:lfs.0 00000004:00000024:2.0:1789575736.360778:0:15386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789575736.360877:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:13828:x1876505676328960:12345-192.168.202.32@tcp:41:lfs.0 Request processed in 148us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.360885:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00080000:1.0:1789575736.361329:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575736.365452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.365693:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329088 00000100:00100000:3.0:1789575736.365707:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329088 00000100:00100000:3.0:1789575736.365855:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575736.365878:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13828:x1876505676329088:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:3.0:1789575736.365917:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575736.366020:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13828:x1876505676329088:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 146us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575736.366027:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00080000:1.0:1789575736.374927:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575736.376436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.376525:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329216 00000100:00100000:3.0:1789575736.376538:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329216 00000100:00100000:3.0:1789575736.376630:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575736.376641:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13828:x1876505676329216:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:3.0:1789575736.376699:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575736.376806:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:13828:x1876505676329216:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 167us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575736.376829:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00080000:1.0:1789575736.377184:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789575736.491039:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575736.599917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575736.600080:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329344 00000100:00100000:1.0:1789575736.600096:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329344 00000100:00100000:1.0:1789575736.600203:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:1.0:1789575736.600215:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+10:13861:x1876505676329344:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789575736.600234:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575736.600258:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86400/0xc45cc82a2238450f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e14 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575736.600295:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86400/0xc45cc82a2238450f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e14 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575736.600309:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86400/0xc45cc82a2238450f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e14 expref: 11 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575736.600319:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86400, rc 0) 00000100:00100000:1.0:1789575736.600458:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329344:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 244us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575736.600492:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:0.0:1789575736.613242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.613472:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329472 00000100:00100000:2.0:1789575736.613486:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329472 00000100:00100000:2.0:1789575736.613559:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:2.0:1789575736.613570:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329472:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789575736.613905:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329472:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 335us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.613914:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:2.0:1789575736.635699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.636457:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329600 00000100:00100000:0.0:1789575736.636476:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329600 00000100:00100000:0.0:1789575736.636595:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789575736.636609:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329600:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789575736.637183:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329600:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 575us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.637194:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789575736.645108:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575736.647909:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329728 00000100:00100000:1.0:1789575736.647933:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329728 00000100:00100000:1.0:1789575736.648049:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:1.0:1789575736.648063:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13867:x1876505676329728:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789575736.648516:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13867:x1876505676329728:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 454us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575736.648525:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:2.0:1789575736.679717:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.680119:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329856 00000100:00100000:0.0:1789575736.680138:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329856 00000100:00100000:0.0:1789575736.680213:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:0.0:1789575736.680226:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13867:x1876505676329856:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789575736.680697:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13867:x1876505676329856:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 470us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.680707:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:3.0:1789575736.683810:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.683973:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676329984 00000100:00100000:2.0:1789575736.683991:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676329984 00000100:00100000:2.0:1789575736.684118:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:2.0:1789575736.684131:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13861:x1876505676329984:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789575736.684168:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575736.684198:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef8000/0xc45cc82a22384516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e3e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575736.684245:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef8000/0xc45cc82a22384516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e3e expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575736.684258:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef8000/0xc45cc82a22384516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e3e expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575736.684270:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8000, rc 0) 00000100:00100000:2.0:1789575736.684356:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13861:x1876505676329984:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 227us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.684364:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:0.0:1789575736.696976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.697419:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330112 00000100:00100000:2.0:1789575736.697439:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330112 00000100:00100000:2.0:1789575736.697541:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:2.0:1789575736.697557:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13861:x1876505676330112:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789575736.697600:0:14295:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789575736.697641:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789575736.697646:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789575736.697650:0:14295:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789575736.697653:0:14295:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789575736.700853:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13861:x1876505676330112:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 3283us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.700874:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:3.0:1789575736.705747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.705953:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330240 00000100:00100000:0.0:1789575736.705966:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330240 00000100:00100000:0.0:1789575736.706046:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:0.0:1789575736.706057:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13861:x1876505676330240:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789575736.706293:0:14294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575736.706322:0:14294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e45 expref: -99 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.706364:0:14294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 13 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.706509:0:14294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 13 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.706538:0:14294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96c2076000, rc 0) 00000100:00100000:1.0:1789575736.706987:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13861:x1876505676330240:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 927us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575736.707005:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:0.0:1789575736.709181:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.709433:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330368 00000100:00100000:2.0:1789575736.709450:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330368 00000100:00100000:2.0:1789575736.709524:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:2.0:1789575736.709537:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13861:x1876505676330368:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789575736.710020:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13861:x1876505676330368:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 482us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.710030:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:3.0:1789575736.712511:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575736.712633:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330496 00000100:00100000:1.0:1789575736.712648:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330496 00000100:00100000:1.0:1789575736.712728:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:1.0:1789575736.712740:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13861:x1876505676330496:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789575736.713057:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13861:x1876505676330496:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 318us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575736.713065:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:3.0:1789575736.717338:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.717665:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330624 00000100:00100000:0.0:1789575736.717689:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330624 00000100:00100000:0.0:1789575736.717801:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:0.0:1789575736.717813:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13872:x1876505676330624:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789575736.718300:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13872:x1876505676330624:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 486us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.718311:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:0.0:1789575736.739610:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575736.739754:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330752 00000100:00100000:2.0:1789575736.739768:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330752 00000100:00100000:2.0:1789575736.739850:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:2.0:1789575736.739864:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13872:x1876505676330752:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789575736.740251:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13872:x1876505676330752:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 389us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575736.740261:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:0.0:1789575736.746565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575736.746702:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676330880 00000100:00100000:1.0:1789575736.746717:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676330880 00000100:00100000:1.0:1789575736.746786:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575736.746798:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2354:x1876505676330880:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789575736.746841:0:14300:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1319281b-72e3-49ea-9146-137043c48047@192.168.202.32@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1789575736.746907:0:14300:0:(genops.c:1384:class_connect()) connect: client 1319281b-72e3-49ea-9146-137043c48047, cookie 0xc45cc82a22384524 00000004:00100000:1.0:1789575736.746965:0:14300:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789575736.747135:0:14300:0:(import.c:65:import_set_state_nolock()) ffff8e9687983800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789575736.747246:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+6:2354:x1876505676330880:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 447us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575736.747255:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575736.772934:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575736.773056:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.773549:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331136 00000100:00100000:0.0:1789575736.773575:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331136 00000100:00100000:0.0:1789575736.773660:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331008 00000100:00100000:0.0:1789575736.773664:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331008 00000100:00100000:0.0:1789575736.773705:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789575736.773718:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+7:13861:x1876505676331136:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789575736.773762:0:15386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789575736.773867:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+7:13861:x1876505676331136:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 150us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.773876:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789575736.773900:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789575736.773908:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:0:x1876505676331008:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789575736.773921:0:15386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789575736.773964:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:0:x1876505676331008:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 57us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.773971:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00080000:0.0:1789575736.774467:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789575736.780590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.780697:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331264 00000100:00100000:3.0:1789575736.780712:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331264 00000100:00100000:3.0:1789575736.780793:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575736.780807:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:13861:x1876505676331264:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789575736.780920:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:13861:x1876505676331264:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575736.780929:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575736.783938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.784349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.784425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575736.784455:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331392 00000100:00100000:3.0:1789575736.784467:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331392 00000100:00100000:3.0:1789575736.784510:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331520 00000100:00100000:3.0:1789575736.784513:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331520 00000100:00100000:3.0:1789575736.784533:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789575736.784544:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876505676331392:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789575736.784589:0:14987:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1319281b-72e3-49ea-9146-137043c48047@192.168.202.32@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1789575736.784633:0:14987:0:(genops.c:1384:class_connect()) connect: client 1319281b-72e3-49ea-9146-137043c48047, cookie 0xc45cc82a2238452b 00002000:00100000:3.0:1789575736.784650:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1319281b-72e3-49ea-9146-137043c48047/ffff8e96878e4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575736.784666:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575736.785366:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789575736.785454:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8e96878e1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575736.785566:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+6:2354:x1876505676331392:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 1021us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575736.785579:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789575736.785615:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789575736.785623:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1876505676331520:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789575736.785652:0:14987:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1319281b-72e3-49ea-9146-137043c48047@192.168.202.32@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1789575736.785689:0:14987:0:(genops.c:1384:class_connect()) connect: client 1319281b-72e3-49ea-9146-137043c48047, cookie 0xc45cc82a22384532 00002000:00100000:3.0:1789575736.785699:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1319281b-72e3-49ea-9146-137043c48047/ffff8e96878e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789575736.785708:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789575736.785794:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789575736.785813:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8e96878e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789575736.785838:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+6:2354:x1876505676331520:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 215us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575736.785845:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789575736.789459:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331648 00000100:00100000:0.0:1789575736.789483:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331648 00000100:00100000:0.0:1789575736.790269:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789575736.790285:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+6:13861:x1876505676331648:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789575736.790433:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789575736.790563:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+6:13861:x1876505676331648:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 281us (6644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.790572:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000001:00100000:0.0:1789575736.818722:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68701ed1-8a58-4b10-b854-0f15bbb165d2 00000100:00100000:3.0:1789575736.960520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575736.960639:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331776 00000100:00100000:0.0:1789575736.960653:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331776 00000100:00100000:0.0:1789575736.960747:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:0.0:1789575736.960760:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+6:13893:x1876505676331776:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:0.0:1789575736.960789:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575736.960818:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077200/0xc45cc82a22384539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e6f expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.960932:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.960949:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.960966:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575736.961033:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575736.961037:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575736.961062:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.961103:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077200/0xc45cc82a22384539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 8 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.961128:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 7 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575736.961138:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:0.0:1789575736.961141:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575736.961146:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f3000, rc 0) 00000100:00100000:0.0:1789575736.961524:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+7:13893:x1876505676331776:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 766us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575736.961532:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00010000:00010000:2.0:1789575737.513766:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575738.281103:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699397376:0@lo:400:kworker.0 00000100:00100000:0.0:1789575738.281235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575738.281397:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397376 00000100:00100000:0.0:1789575738.281407:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397376 00000100:00100000:0.0:1789575738.281472:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789575738.281482:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699397376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575738.281622:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699397376:12345-0@lo:400:kworker.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575738.281631:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789575738.281729:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699397376:0@lo:400:kworker.0 00000100:00100000:1.0:1789575738.281993:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699397760:0@lo:400:kworker.0 00000100:00100000:1.0:1789575738.282040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575738.282393:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397760 00000100:00100000:0.0:1789575738.282398:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397760 00000100:00100000:0.0:1789575738.282445:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575738.282454:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699397760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.283740:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699397504:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.283810:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575738.283859:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575738.283888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575738.283918:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575738.283924:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699397632:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.283959:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575738.283988:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699398144:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.284016:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575738.284076:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398016 00000100:00100000:2.0:1789575738.284100:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398016 00000100:00100000:2.0:1789575738.284164:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575738.284172:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575738.284208:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575738.284246:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575738.284252:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789575738.284273:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397504 00000100:00100000:2.0:1789575738.284275:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397504 00000100:00100000:2.0:1789575738.284294:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397632 00000100:00100000:2.0:1789575738.284296:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397632 00000100:00100000:3.0:1789575738.284479:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789575738.284495:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699397504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575738.284527:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699397504:12345-0@lo:400:kworker.0 Request processed in 43us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575738.284533:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789575738.284548:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789575738.284554:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699397632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575738.284588:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699397632:12345-0@lo:400:kworker.0 Request processed in 35us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575738.284602:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789575738.284802:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699397760:12345-0@lo:400:kworker.0 Request processed in 2347us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575738.284814:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789575738.284835:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398144 00000100:00100000:0.0:1789575738.284838:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398144 00000100:00100000:0.0:1789575738.284860:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789575738.284864:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699398144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575738.284896:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699398144:12345-0@lo:400:kworker.0 Request processed in 31us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575738.284902:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789575738.285127:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789575738.285132:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575738.285133:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789575738.285171:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789575738.285193:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699397632:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.285204:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699398144:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.285212:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699397504:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.285224:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc23ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575738.285246:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699397888:0@lo:400:kworker.0 00000100:00100000:2.0:1789575738.285272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575738.286958:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699397888 00000100:00100000:3.0:1789575738.286989:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699397888 00000100:00100000:3.0:1789575738.287100:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789575738.287112:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699397888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575738.287220:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699397888:12345-0@lo:400:kworker.0 Request processed in 110us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575738.287226:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789575738.287493:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575738.287552:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699397888:0@lo:400:kworker.0 00000100:00100000:1.0:1789575738.288700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699397760:0@lo:400:kworker.0 00000001:00100000:3.0:1789575738.377828:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1319281b-72e3-49ea-9146-137043c48047 00000001:00100000:3.0:1789575738.377858:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68701ed1-8a58-4b10-b854-0f15bbb165d2 00010000:00010000:0.0:1789575738.538716:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789575739.383782:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1319281b-72e3-49ea-9146-137043c48047 00000001:00100000:1.0:1789575739.383805:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68701ed1-8a58-4b10-b854-0f15bbb165d2 00010000:00010000:2.0:1789575739.560723:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789575740.208844:0:16265:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789575740.584917:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575740.840678:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575740.840717:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699398272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575740.840842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575740.841402:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398272 00000100:00100000:2.0:1789575740.841436:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398272 00000100:00080000:0.0:1789575740.841508:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575740.842039:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575740.842164:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699398272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789575740.842217:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575740.842311:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699398272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575740.842318:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789575740.842585:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699398272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789575741.613730:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789575742.004677:0:6734:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1319281b-72e3-49ea-9146-137043c48047 00000040:00080000:0.0:1789575742.057712:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789575742.103476:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103529:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103566:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103713:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575742.103743:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332160 00000100:00100000:3.0:1789575742.103758:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332160 00000100:00100000:3.0:1789575742.103841:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332672 00000100:00100000:3.0:1789575742.103844:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332672 00000100:00100000:3.0:1789575742.103881:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332288 00000100:00100000:3.0:1789575742.103884:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332288 00000100:00100000:3.0:1789575742.103897:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332544 00000100:00100000:3.0:1789575742.103899:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332544 00000100:00100000:3.0:1789575742.103920:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575742.103934:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676332160:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104047:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676332160:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 114us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104057:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575742.104078:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575742.104085:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676332672:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104112:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676332672:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104117:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575742.104129:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575742.104134:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676332288:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104156:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676332288:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104163:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789575742.104173:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789575742.104181:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676332544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104208:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676332544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104215:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789575742.104251:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332416 00000100:00100000:3.0:1789575742.104263:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332416 00000100:00100000:3.0:1789575742.104318:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332032 00000100:00100000:3.0:1789575742.104323:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332032 00000100:00100000:3.0:1789575742.104353:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575742.104362:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+6:2357:x1876505676332416:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104434:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+6:2357:x1876505676332416:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 73us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104442:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789575742.104458:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789575742.104466:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2357:x1876505676332032:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575742.104493:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2357:x1876505676332032:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575742.104500:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789575742.104647:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676331904 00000100:00100000:0.0:1789575742.104672:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676331904 00000100:00100000:0.0:1789575742.104766:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:0.0:1789575742.104781:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2357:x1876505676331904:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575742.104906:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2357:x1876505676331904:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 129us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575742.104914:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00080000:0.0:1789575742.104979:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789575742.104988:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575742.104991:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789575742.636877:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575743.410762:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699398400:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.410879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575743.410958:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398400 00000100:00100000:2.0:1789575743.410967:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699398912:0@lo:400:kworker.0 00000100:00100000:0.0:1789575743.410977:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398400 00000100:00100000:2.0:1789575743.411021:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575743.411085:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789575743.411091:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789575743.411105:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699398400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411107:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699398784:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411161:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575743.411208:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575743.411246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575743.411285:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699399040:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575743.411340:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699398400:12345-0@lo:400:kworker.0 Request processed in 240us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575743.411352:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789575743.411363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789575743.411486:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398656:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411520:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575743.411556:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699399168:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575743.411642:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398912 00000100:00100000:2.0:1789575743.411651:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398912 00000100:00100000:2.0:1789575743.411707:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399040 00000100:00100000:2.0:1789575743.411721:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399040 00000100:00100000:2.0:1789575743.411753:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399168 00000100:00100000:2.0:1789575743.411756:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399168 00000100:00100000:2.0:1789575743.411774:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789575743.411782:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699398912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411835:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876505699398912:12345-0@lo:400:kworker.0 Request processed in 54us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.411844:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789575743.411865:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789575743.411871:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699399040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411905:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876505699399040:12345-0@lo:400:kworker.0 Request processed in 35us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.411911:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789575743.411926:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789575743.411932:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699399168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.411958:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699399168:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.411964:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789575743.411985:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398784 00000100:00100000:2.0:1789575743.411989:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398784 00000100:00100000:2.0:1789575743.412020:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398656 00000100:00100000:2.0:1789575743.412024:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398656 00000100:00100000:2.0:1789575743.412040:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575743.412047:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699398784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412078:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699398784:12345-0@lo:400:kworker.0 Request processed in 31us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.412084:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789575743.412104:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789575743.412110:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412140:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398656:12345-0@lo:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.412147:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789575743.412171:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699398528 00000100:00100000:2.0:1789575743.412176:0:14989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699398528 00000100:00100000:2.0:1789575743.412210:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789575743.412218:0:14989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789575743.412261:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789575743.412299:0:14989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699398528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575743.412306:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789575743.412356:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699398784:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412413:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699398400:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412430:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876505699398912:0@lo:400:kworker.0 00000100:00080000:2.0:1789575743.412502:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789575743.412508:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789575743.412511:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575743.412530:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398656:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412541:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699399168:0@lo:400:kworker.0 00000100:00100000:2.0:1789575743.412559:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699398528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789575743.412572:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876505699399040:0@lo:400:kworker.0 00010000:00010000:3.0:1789575743.665695:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575744.680629:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789575744.796099:0:16417:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff115831e0 20000000:00000080:3.0:1789575744.796128:0:16417:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9586299400 uarg=0000000000000000 20000000:01000000:3.0:1789575744.796181:0:16417:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789575744.796189:0:16417:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789575744.796194:0:16417:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789575744.797617:0:16418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789575744.797899:0:16417:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789575744.803838:0:16417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789575744.803893:0:16417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804121:0:16417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384237 expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804132:0:16417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384284 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804162:0:16417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804173:0:16417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804181:0:16417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804189:0:16417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804254:0:16417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804276:0:16417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.804299:0:16417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399296:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575744.804913:0:16417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.804935:0:16417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.804946:0:16417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399424:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575744.804989:0:16417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.805242:0:16417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.805253:0:16417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399552:0@lo:104: 00000100:00100000:3.0:1789575744.805306:0:16417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789575744.805709:0:16417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.805718:0:16417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 18 pid: 14295 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.805728:0:16417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399680:0@lo:104: 00000100:00100000:3.0:1789575744.805753:0:16417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789575744.806764:0:16417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 18 pid: 14294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575744.806780:0:16417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 18 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.806793:0:16417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399808:0@lo:104: 00000100:00100000:3.0:1789575744.806848:0:16417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575744.807117:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399552 00000100:00100000:2.0:1789575744.807144:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399552 00000100:00100000:2.0:1789575744.807204:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399680 00000100:00100000:2.0:1789575744.807208:0:14283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399680 00000100:00100000:2.0:1789575744.807224:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575744.807234:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+4:16417:x1876505699399552:12345-0@lo:104: 00010000:00010000:2.0:1789575744.807250:0:14283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807327:0:14283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789575744.807333:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+4:16417:x1876505699399552:12345-0@lo:104: Request processed in 102us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575744.807340:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575744.807365:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789575744.807396:0:14283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+3:16417:x1876505699399680:12345-0@lo:104: 00010000:00010000:2.0:1789575744.807405:0:14283:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807442:0:14283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789575744.807457:0:14283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:75adfecc-338c-4204-8932-8d3be75fd826+3:16417:x1876505699399680:12345-0@lo:104: Request processed in 78us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575744.807463:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789575744.807489:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789575744.807496:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807505:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe86a00 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575744.807510:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807532:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575744.807540:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575744.807547:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789575744.807589:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807596:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575744.807642:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807652:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96bbe86a00/0xc45cc82a223843bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a223843c6 expref: -99 pid: 15705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807670:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575744.807673:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807678:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87400 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575744.807681:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807687:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575744.807692:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575744.807703:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789575744.807716:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807722:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789575744.807729:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807734:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96bbe87400/0xc45cc82a22384284 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238428b expref: -99 pid: 14983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.807743:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575744.807745:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575744.807747:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575744.807778:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699399936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575744.807824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575744.807862:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789575744.807869:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699400064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575744.807890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575744.808121:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399936 00000100:00100000:2.0:1789575744.808129:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399936 00010000:00010000:2.0:1789575744.808156:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 19 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575744.808185:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400064 00000100:00100000:2.0:1789575744.808188:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400064 00010000:00010000:2.0:1789575744.808200:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 20 pid: 14295 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575744.808228:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575744.808235:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+20:3306:x1876505699399936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575744.808251:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575744.808257:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 20 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.808267:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 20 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.808291:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575744.808328:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+20:3306:x1876505699399936:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575744.808336:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789575744.808351:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789575744.808356:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+19:3306:x1876505699400064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789575744.808365:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575744.808411:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 19 pid: 14295 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.808421:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 19 pid: 14295 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.808431:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575744.808453:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+19:3306:x1876505699400064:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575744.808460:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789575744.808509:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699400064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789575744.808530:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:75adfecc-338c-4204-8932-8d3be75fd826:3306:1876505699399936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789575744.808668:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575744.810933:0:16417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bbbe5b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789575744.810995:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96813d1200/0xc45cc82a223843c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a223843bf expref: 18 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.811032:0:16417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399552:0@lo:104: 00010000:00010000:3.0:1789575744.811047:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96bbe87600/0xc45cc82a2238428b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22384284 expref: 17 pid: 14295 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.811088:0:16417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399680:0@lo:104: 00000100:00100000:1.0:1789575744.811323:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699399808 00000100:00100000:1.0:1789575744.811336:0:14284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699399808 00000100:00100000:2.0:1789575744.811541:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789575744.811738:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575744.811752:0:14284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:16417:x1876505699399808:12345-0@lo:104: 00010000:00010000:1.0:1789575744.811777:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.812394:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789575744.812405:0:14284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:75adfecc-338c-4204-8932-8d3be75fd826+3:16417:x1876505699399808:12345-0@lo:104: Request processed in 655us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575744.812413:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789575744.812523:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789575744.812532:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.812540:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96813d1600 already unused, calling callback (ffffffffc1df5c20) 10000000:00010000:2.0:1789575744.812546:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.812556:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789575744.812563:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789575744.812570:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789575744.812644:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.812652:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789575744.812704:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699400192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789575744.812767:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789575744.812828:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.812836:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff8e96813d1600/0xc45cc82a22384237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc45cc82a2238423e expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.812866:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575744.812868:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789575744.812877:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575744.813169:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400192 00000100:00100000:1.0:1789575744.813180:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400192 00010000:00010000:1.0:1789575744.813214:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 17 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575744.813279:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789575744.813289:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c128d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+17:3308:x1876505699400192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789575744.813304:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575744.813311:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 17 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.813322:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 17 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.813341:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575744.813409:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c128d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75adfecc-338c-4204-8932-8d3be75fd826+17:3308:x1876505699400192:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575744.813416:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789575744.813525:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699400192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789575744.813641:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96bbe86000/0xc45cc82a2238423e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc45cc82a22384237 expref: 16 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575744.813655:0:16417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399808:0@lo:104: 00000100:00100000:0.0:1789575744.829717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575744.830301:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332800 00000100:00100000:2.0:1789575744.830316:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332800 00010000:00010000:2.0:1789575744.830410:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 13 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575744.830460:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789575744.830472:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2358:x1876505676332800:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575744.830690:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575744.830698:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 13 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.830713:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 13 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575744.830742:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575744.830818:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2358:x1876505676332800:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 349us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575744.830827:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00010000:00010000:1.0:1789575744.831240:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076000/0xc45cc82a2238451d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e45 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575744.831259:0:16417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399296:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575744.831271:0:16417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16417:1876505699399424:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575744.831304:0:16417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575744.831730:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575744.831835:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676332928 00000100:00100000:1.0:1789575744.831860:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676332928 00010000:00010000:1.0:1789575744.831888:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575744.831966:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:1.0:1789575744.831977:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:2357:x1876505676332928:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575744.831990:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575744.831997:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832009:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832023:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96c2076400/0xc45cc82a223844e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5de3 expref: 12 pid: 14294 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832041:0:14285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832051:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832069:0:14285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832153:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832285:0:14285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832310:0:14285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832317:0:14285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575744.832321:0:14285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832331:0:14285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832348:0:14285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832360:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575744.832670:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:2357:x1876505676332928:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 693us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575744.832679:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00010000:00010000:1.0:1789575744.832712:0:16417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832720:0:16417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575744.832726:0:16417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e96bcdd2400/0xc45cc82a22384547 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575745.705890:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575745.985615:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789575745.985648:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575745.985749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575745.985838:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400320 00000100:00100000:3.0:1789575745.985850:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400320 00000100:00100000:3.0:1789575745.985921:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789575745.985935:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699400320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789575745.985972:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575745.986028:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699400320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575745.986035:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789575745.986059:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789575745.986158:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789575745.996564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575745.997229:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333056 00000100:00100000:1.0:1789575745.997241:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333056 00000100:00100000:1.0:1789575745.997318:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:1.0:1789575745.997329:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+11:13749:x1876505676333056:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575745.997349:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575745.997396:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86800/0xc45cc82a2238454e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e76 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575745.997429:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86800/0xc45cc82a2238454e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e76 expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575745.997442:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86800/0xc45cc82a2238454e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e76 expref: 12 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575745.997452:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86800, rc 0) 00000100:00100000:1.0:1789575745.997520:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333056:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 192us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575745.997526:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:0.0:1789575746.010519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575746.010882:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333184 00000100:00100000:1.0:1789575746.010898:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333184 00000100:00100000:1.0:1789575746.010975:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:1.0:1789575746.010988:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333184:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575746.011343:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333184:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 355us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575746.011351:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:3.0:1789575746.014347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575746.014438:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333312 00000100:00100000:0.0:1789575746.014449:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333312 00000100:00100000:0.0:1789575746.014497:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:0.0:1789575746.014507:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9687f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333312:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.014815:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9687f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333312:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 309us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575746.014823:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:0.0:1789575746.030298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575746.031033:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333440 00000100:00100000:1.0:1789575746.031050:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333440 00000100:00100000:1.0:1789575746.031117:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:1.0:1789575746.031127:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+12:13749:x1876505676333440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789575746.031159:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575746.031183:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bbe86000/0xc45cc82a22384555 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e7d expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575746.031217:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bbe86000/0xc45cc82a22384555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e7d expref: 13 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575746.031230:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bbe86000/0xc45cc82a22384555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e7d expref: 13 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575746.031240:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86000, rc 0) 00000100:00100000:1.0:1789575746.031310:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13749:x1876505676333440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575746.031318:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789575746.038270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575746.038404:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333568 00000100:00100000:1.0:1789575746.038417:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333568 00000100:00100000:1.0:1789575746.038472:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:1.0:1789575746.038481:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13749:x1876505676333568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575746.038810:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13749:x1876505676333568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 328us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575746.038819:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:0.0:1789575746.042368:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575746.042473:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333696 00000100:00100000:3.0:1789575746.042486:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333696 00000100:00100000:3.0:1789575746.042549:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:3.0:1789575746.042561:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13749:x1876505676333696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.042865:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:13749:x1876505676333696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 305us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.042881:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 112 10000000:01000000:0.0:1789575746.536486:0:14297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575746.536496:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e9584e47000 from 10 10000000:01000000:0.0:1789575746.536502:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575746.536557:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.536570:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.536592:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575746.536625:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.536721:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.536785:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789575746.536898:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400448 00000100:00100000:3.0:1789575746.536922:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400448 00000100:00100000:3.0:1789575746.537010:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789575746.537027:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+16:14297:x1876505699400448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575746.537043:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575746.537057:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd3e00/0xc45cc82a22384563 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238455c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.537080:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd3e00/0xc45cc82a22384563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238455c expref: 17 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.537091:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bcdd3e00/0xc45cc82a22384563 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238455c expref: 17 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.537099:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3e00, rc 0) 00000100:00100000:3.0:1789575746.537148:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.537155:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789575746.537173:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575746.537186:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384563 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.537196:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384563 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575746.537248:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.537274:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.537296:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9240 going to sleep for 11 seconds 00000100:00100000:1.0:1789575746.537340:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400576 00000100:00100000:1.0:1789575746.537345:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400576 00000100:00100000:1.0:1789575746.537399:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789575746.537407:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789575746.537804:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 397us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575746.537819:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789575746.537843:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc417480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.537874:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.537925:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575746.537957:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96812ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789575746.543820:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400704 00000100:00100000:0.0:1789575746.543843:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400704 00000100:00100000:0.0:1789575746.543926:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789575746.543938:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.544963:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1022us (7031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575746.544974:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789575746.551181:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789575746.552800:0:16475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789575746.553052:0:14297:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789575746.553075:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789575746.553087:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384563 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.553099:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f2800/0xc45cc82a2238455c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384563 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575746.553109:0:14297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575746.553112:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e968522c000 from 10 10000000:01000000:0.0:1789575746.553115:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575746.553152:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.553161:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.553171:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575746.553195:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.553263:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.553310:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575746.553454:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400832 00000100:00100000:3.0:1789575746.553462:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400832 00000100:00100000:3.0:1789575746.553505:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789575746.553514:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+17:14297:x1876505699400832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575746.553538:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575746.553554:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e96bcdd2800/0xc45cc82a22384571 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a2238456a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.553581:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e96bcdd2800/0xc45cc82a22384571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a2238456a expref: 18 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.553602:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e96bcdd2800/0xc45cc82a22384571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a2238456a expref: 18 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.553612:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2800, rc 0) 00000100:00100000:3.0:1789575746.553656:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699400832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.553663:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789575746.555476:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789575746.555500:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384571 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.555511:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a22384571 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575746.555595:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.555651:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575746.555685:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96898a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1789575746.555755:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699400960 00000100:00100000:0.0:1789575746.555763:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699400960 00000100:00100000:0.0:1789575746.555805:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789575746.555814:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699400960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.556165:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699400960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575746.556172:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789575746.556286:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699400960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789575746.556320:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789575746.556361:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575746.556406:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96bc658cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789575746.556471:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401088 00000100:00100000:3.0:1789575746.556476:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401088 00000100:00100000:3.0:1789575746.556501:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789575746.556507:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699401088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.556664:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699401088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.556671:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789575746.556794:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bd1da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789575746.562332:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789575746.562558:0:14297:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789575746.562596:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789575746.562610:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384571 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.562622:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3c00/0xc45cc82a2238456a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a22384571 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789575746.562634:0:14297:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789575746.562637:0:14297:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e96bd0ce000 from 10 10000000:01000000:0.0:1789575746.562641:0:14297:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789575746.562684:0:14297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.562693:0:14297:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.562706:0:14297:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575746.562737:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.562809:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.562860:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789575746.563055:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401216 00000100:00100000:2.0:1789575746.563066:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401216 00000100:00100000:2.0:1789575746.563127:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789575746.563137:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+18:14297:x1876505699401216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789575746.563151:0:14292:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575746.563165:0:14292:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9687ef9400/0xc45cc82a2238457f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc45cc82a22384578 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575746.563191:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9687ef9400/0xc45cc82a2238457f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc45cc82a22384578 expref: 19 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575746.563202:0:14292:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9687ef9400/0xc45cc82a2238457f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc45cc82a22384578 expref: 19 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575746.563211:0:14292:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9400, rc 0) 00000100:00100000:2.0:1789575746.563260:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb585c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699401216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575746.563267:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789575746.563349:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789575746.563363:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238457f expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.563434:0:14297:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc45cc82a2238457f expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575746.563491:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.563517:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.563539:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575746.563621:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401344 00000100:00100000:3.0:1789575746.563625:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401344 00000100:00100000:3.0:1789575746.563653:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789575746.563660:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699401344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.563929:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bb584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699401344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.563936:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789575746.564011:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.564039:0:14297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789575746.564075:0:14297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575746.564103:0:14297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789575746.564292:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401472 00000100:00100000:3.0:1789575746.564297:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401472 00000100:00100000:3.0:1789575746.564327:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789575746.564334:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96b0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699401472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789575746.564498:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96b0f17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75adfecc-338c-4204-8932-8d3be75fd826+19:14297:x1876505699401472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575746.564505:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789575746.564596:0:14297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc414380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:75adfecc-338c-4204-8932-8d3be75fd826:14297:1876505699401472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789575746.565534:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789575746.565691:0:14297:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789575746.565708:0:14297:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789575746.565718:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238457f expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575746.565727:0:14297:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff8e96bb2f3400/0xc45cc82a22384578 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc45cc82a2238457f expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575746.739472:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575747.227422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575747.227480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575747.227493:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333952 00000100:00100000:2.0:1789575747.227510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575747.227512:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333952 00000100:00100000:2.0:1789575747.227556:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575747.227625:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789575747.227633:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575747.227647:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2355:x1876505676333952:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575747.227664:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575747.227692:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575747.227720:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334208 00000100:00100000:2.0:1789575747.227731:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334208 00000100:00100000:0.0:1789575747.227769:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2355:x1876505676333952:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575747.227779:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789575747.227809:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334464 00000100:00100000:0.0:1789575747.227810:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334336 00000100:00100000:2.0:1789575747.227818:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334464 00000100:00100000:0.0:1789575747.227821:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334336 00000100:00100000:2.0:1789575747.227848:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334080 00000100:00100000:2.0:1789575747.227853:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334080 00000100:00100000:0.0:1789575747.227871:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:2.0:1789575747.227888:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334592 00000100:00100000:0.0:1789575747.227888:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+6:2355:x1876505676334336:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575747.227893:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334592 00000100:00100000:2.0:1789575747.227911:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575747.227920:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2355:x1876505676334208:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575747.228085:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+6:2355:x1876505676334336:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 204us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575747.228092:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789575747.228126:0:14985:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789575747.228137:0:14985:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1789575747.228159:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575747.228164:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575747.228168:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789575747.229888:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2355:x1876505676334208:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1957us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575747.229902:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575747.229939:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575747.229955:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2355:x1876505676334464:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575747.231996:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2355:x1876505676334464:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 2043us (4480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575747.232007:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575747.232046:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789575747.232061:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2355:x1876505676334080:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789575747.232093:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2355:x1876505676334080:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 39us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575747.232099:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789575747.232118:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575747.232129:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676333824 00000100:00100000:2.0:1789575747.232130:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2355:x1876505676334592:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575747.232149:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676333824 00000100:00100000:2.0:1789575747.232163:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1319281b-72e3-49ea-9146-137043c48047+5:2355:x1876505676334592:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 38us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575747.232192:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789575747.233398:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:3.0:1789575747.233419:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2355:x1876505676333824:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789575747.233491:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2355:x1876505676333824:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 81us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575747.233499:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00010000:00010000:0.0:1789575747.753154:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789575748.521087:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699401856:0@lo:400:kworker.0 00000100:00100000:1.0:1789575748.521219:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575748.521302:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789575748.521309:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699401984:0@lo:400:kworker.0 00000100:00100000:1.0:1789575748.521340:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575748.521443:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401984 00000100:00100000:1.0:1789575748.521451:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401984 00000100:00100000:1.0:1789575748.521508:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789575748.521517:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699401984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575748.521583:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876505699401984:12345-0@lo:400:kworker.0 Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575748.521590:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789575748.521637:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876505699401984:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522030:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699401728:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575748.522113:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699402240:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575748.522154:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789575748.522160:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699401600:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575748.522207:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699402112:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522228:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575748.522254:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699402240 00000100:00100000:0.0:1789575748.522258:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699402240 00000100:00100000:0.0:1789575748.522291:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699402112 00000100:00100000:0.0:1789575748.522294:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699402112 00000100:00100000:0.0:1789575748.522313:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789575748.522319:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699402240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522357:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876505699402240:12345-0@lo:400:kworker.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575748.522363:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789575748.522416:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789575748.522422:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699402112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522449:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876505699402112:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575748.522454:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789575748.522470:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575748.522491:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876505699402112:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.522499:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc23b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876505699402240:0@lo:400:kworker.0 00000100:00100000:3.0:1789575748.522672:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401856 00000100:00100000:3.0:1789575748.522678:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401856 00000100:00100000:3.0:1789575748.522721:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401728 00000100:00100000:3.0:1789575748.522724:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401728 00000100:00100000:3.0:1789575748.522743:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789575748.522753:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699401856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575748.522828:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876505699401856:12345-0@lo:400:kworker.0 Request processed in 77us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575748.522834:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789575748.522847:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789575748.522854:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699401728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575748.522884:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699401728:12345-0@lo:400:kworker.0 Request processed in 32us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575748.522890:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789575748.522920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876505699401856:0@lo:400:kworker.0 00000100:00100000:2.0:1789575748.523162:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699401600 00000100:00100000:2.0:1789575748.523167:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699401600 00000100:00100000:2.0:1789575748.523202:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789575748.523210:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699401600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789575748.523247:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75adfecc-338c-4204-8932-8d3be75fd826+19:3307:x1876505699401600:12345-0@lo:400:kworker.0 Request processed in 39us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575748.523253:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789575748.523448:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789575748.523460:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699402368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575748.523512:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575748.523581:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699402368 00000100:00100000:3.0:1789575748.523585:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699402368 00000100:00100000:3.0:1789575748.523614:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575748.523633:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699402368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789575748.523666:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575748.523706:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699402368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575748.523712:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789575748.523749:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699402368:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789575748.523876:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575748.523882:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789575748.523902:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:75adfecc-338c-4204-8932-8d3be75fd826:3307:1876505699401600:0@lo:400:kworker.0 00000100:00100000:0.0:1789575748.523916:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699401728:0@lo:400:kworker.0 00010000:00010000:0.0:1789575748.776952:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575749.416533:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.417293:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334720 00000100:00100000:2.0:1789575749.417314:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334720 00000100:00100000:2.0:1789575749.417480:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789575749.417501:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:14403:x1876505676334720:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575749.417535:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1789575749.417571:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789575749.422071:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22384586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e84 expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422175:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422193:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422212:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422231:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422259:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.422266:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424188:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a2238459b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424215:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a2238459b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424228:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a2238459b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.424266:0:15386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575749.424270:0:15386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575749.424318:0:15386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a2238459b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424333:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424341:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424350:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424357:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8800 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.424361:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424411:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424426:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:2.0:1789575749.424429:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.424435:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424441:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a2238458d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424456:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424462:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424468:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424473:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.424476:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424482:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424488:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e9687bd9d00) 00010000:00010000:2.0:1789575749.424490:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.424493:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.424508:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a22384594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.426250:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8a00/0xc45cc82a22384586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e84 expref: 8 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.426286:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9a00/0xc45cc82a2238459b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e84 expref: 7 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.426294:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9687bd9000) 00010000:00010000:2.0:1789575749.426298:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575749.426302:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9a00, rc 0) 00000100:00100000:2.0:1789575749.426458:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:14403:x1876505676334720:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 8962us (9938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575749.426468:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:1.0:1789575749.429868:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.430970:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676334976 00000100:00100000:0.0:1789575749.430990:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676334976 00000100:00100000:0.0:1789575749.431074:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789575749.431085:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:14403:x1876505676334976:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575749.431109:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.431130:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223845a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e8b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431221:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431259:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431272:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431288:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431295:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431302:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431932:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2c00/0xc45cc82a223845b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431943:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2c00/0xc45cc82a223845b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.431951:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2c00/0xc45cc82a223845b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575749.431962:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789575749.432154:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432161:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432168:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432179:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.432183:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432191:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432205:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e9687bd9000) 00010000:00010000:0.0:1789575749.432208:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.432213:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432220:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432232:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432237:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432243:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432247:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.432249:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432255:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432271:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e9687dc9200) 00010000:00010000:0.0:1789575749.432274:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.432277:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.432282:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.438977:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223845a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e8b expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.439011:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2c00/0xc45cc82a223845b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e8b expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.439021:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9687dc9100) 00010000:00010000:0.0:1789575749.439024:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.439028:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f2c00, rc 0) 00000100:00100000:0.0:1789575749.439887:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc23b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14403:x1876505676334976:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 8799us (10034us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789575749.439898:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789575749.461059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575749.461189:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335104 00000100:00100000:1.0:1789575749.461209:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335104 00000100:00100000:1.0:1789575749.461299:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:1.0:1789575749.461309:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14403:x1876505676335104:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789575749.461490:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14403:x1876505676335104:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 182us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575749.461499:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789575749.497276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.497480:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335232 00000100:00100000:2.0:1789575749.497504:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335232 00000100:00100000:0.0:1789575749.497725:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789575749.497761:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14409:x1876505676335232:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575749.497801:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.497836:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223845c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e92 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.497976:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.497993:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498008:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498027:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498047:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498057:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498332:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498340:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498347:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498353:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.498357:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498408:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498423:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:0.0:1789575749.498426:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.498433:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498440:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2200/0xc45cc82a223845cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498457:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498463:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498470:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498476:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.498479:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498485:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498493:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e9687dc9200) 00010000:00010000:0.0:1789575749.498495:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.498498:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498514:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2e00/0xc45cc82a223845d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498554:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223845c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e92 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498576:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:0.0:1789575749.498578:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.498583:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223845c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e92 expref: 10 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.498594:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f3800, rc 0) 00000100:00100000:0.0:1789575749.498698:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14409:x1876505676335232:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 957us (1435us total) trans 0 rc 301/301 00000100:00100000:0.0:1789575749.498706:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:3.0:1789575749.511996:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575749.512432:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335360 00000100:00100000:1.0:1789575749.512445:0:14309:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335360 00000100:00100000:1.0:1789575749.512512:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789575749.512546:0:14309:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14409:x1876505676335360:12345-192.168.202.32@tcp:700:lfs.0 00000100:00100000:1.0:1789575749.512669:0:14309:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14409:x1876505676335360:12345-192.168.202.32@tcp:700:lfs.0 Request processed in 125us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575749.512676:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789575749.515658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.515852:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335616 00000100:00100000:0.0:1789575749.515870:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335616 00000100:00100000:0.0:1789575749.516014:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575749.516026:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14409:x1876505676335616:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:0.0:1789575749.516279:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575749.516314:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96c2077a00/0xc45cc82a22384508 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e0d expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.516341:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:0.0:1789575749.516347:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789575749.517332:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.517361:0:14300:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 5 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.517528:0:14300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.517598:0:14300:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 5 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.517622:0:14300:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 5 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575749.517644:0:14300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14300:1876505699402496:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575749.518009:0:14300:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e96915f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575749.525831:0:14300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9585825180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14300:1876505699402496:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575749.525879:0:14300:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575749.526537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.526837:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335744 00000100:00100000:2.0:1789575749.526850:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335744 00010000:00010000:2.0:1789575749.526945:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 6 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.526997:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789575749.527030:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1319281b-72e3-49ea-9146-137043c48047+6:2357:x1876505676335744:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575749.527046:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575749.527054:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 6 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527069:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 6 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527093:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3000/0xc45cc82a22384540 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e6f expref: 6 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527112:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:2.0:1789575749.527117:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527129:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527138:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.527176:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575749.527251:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676335744:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 225us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575749.527261:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00010000:00010000:3.0:1789575749.527266:0:14300:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.527281:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.527322:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.527337:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.527353:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789575749.527522:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789575749.534027:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789575749.534051:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534061:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534078:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534084:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.534089:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534097:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534115:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9900) 00010000:00010000:2.0:1789575749.534119:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.534124:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.534131:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223845da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575749.534153:0:14300:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7bf319a reply state 000000008db6ad13 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.534163:0:14300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575749.534274:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+10:14409:x1876505676335616:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 18246us (18626us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789575749.534283:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00010000:00010000:2.0:1789575749.541924:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.541951:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.541984:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.541991:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.541997:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.542007:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.542028:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e9683773f00) 00010000:00010000:2.0:1789575749.542032:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.542039:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.542046:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a223845e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575749.622077:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:1.0:1789575749.622099:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000100:00100000:3.0:1789575749.659189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.659284:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676335872 00000100:00100000:0.0:1789575749.659295:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676335872 00000100:00100000:0.0:1789575749.659495:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789575749.659508:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:14417:x1876505676335872:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:0.0:1789575749.659536:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.659572:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a223845e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5e99 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.659645:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2a00/0xc45cc82a223845ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.659661:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2a00/0xc45cc82a223845ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.659672:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2a00/0xc45cc82a223845ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575749.659710:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575749.659713:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575749.659750:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2a00/0xc45cc82a223845ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.659776:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a223845e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e99 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.660488:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2a00/0xc45cc82a223845ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5e99 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.660499:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:0.0:1789575749.660502:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575749.660524:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f2a00, rc 0) 00000100:00100000:0.0:1789575749.660620:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:14417:x1876505676335872:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 1114us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575749.660629:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789575749.698259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.698435:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676336000 00000100:00100000:2.0:1789575749.698505:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676336000 00000100:00100000:2.0:1789575749.698596:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789575749.698607:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+5:14418:x1876505676336000:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575749.698631:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575749.698657:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223845f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ea0 expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.698746:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223845fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.699045:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223845fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.699060:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223845fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.699103:0:15386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575749.699108:0:15386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575749.699546:0:15386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223845fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.699592:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9000/0xc45cc82a223845f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ea0 expref: 7 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.699614:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8800/0xc45cc82a223845fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ea0 expref: 6 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.699623:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575749.699626:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789575749.699630:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8800, rc 0) 00000100:00100000:2.0:1789575749.699755:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:14418:x1876505676336000:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1149us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575749.699764:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789575749.710138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.710278:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676336128 00000100:00100000:0.0:1789575749.710289:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676336128 00000100:00100000:0.0:1789575749.710358:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789575749.710399:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+6:14418:x1876505676336128:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575749.710422:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.710671:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a22384604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ea7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710872:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710889:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710902:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710920:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710926:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.710932:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711324:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711614:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711625:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575749.711675:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575749.711679:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575749.711706:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711720:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711727:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711735:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711742:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.711747:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711756:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.711770:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:0.0:1789575749.712411:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.712421:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712428:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a2238460b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712601:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712610:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712616:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712622:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575749.712626:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712633:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712644:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e9687dc9200) 00010000:00010000:0.0:1789575749.712647:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575749.712650:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712656:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384612 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712707:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a22384604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ea7 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712742:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ea7 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.712749:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:0.0:1789575749.712751:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575749.712753:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f2400, rc 0) 00000100:00100000:0.0:1789575749.713128:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1319281b-72e3-49ea-9146-137043c48047+7:14418:x1876505676336128:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2758us (3003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575749.713139:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:3.0:1789575749.730702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.730944:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676336384 00000100:00100000:0.0:1789575749.730965:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676336384 00000100:00100000:0.0:1789575749.731062:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:0.0:1789575749.731074:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+7:14418:x1876505676336384:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575749.731101:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.731126:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a22384620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5eae expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575749.731259:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789575749.732748:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a22384620 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eae expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.732769:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:0.0:1789575749.732773:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789575749.732779:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a22384620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eae expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.732831:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f3e00, rc 0) 00000100:00100000:0.0:1789575749.732938:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+8:14418:x1876505676336384:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1865us (2260us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789575749.732949:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789575749.743624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575749.743737:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676336640 00000100:00100000:3.0:1789575749.743759:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676336640 00000100:00100000:3.0:1789575749.743892:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789575749.743909:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bd1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1319281b-72e3-49ea-9146-137043c48047+8:14418:x1876505676336640:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:3.0:1789575749.744318:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575749.744366:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2400/0xc45cc82a22384619 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ea7 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.744472:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9e00) 00010000:00010000:3.0:1789575749.744489:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789575749.744528:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.744547:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575749.744571:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789575749.745612:0:14302:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e69ba74b reply state 00000000393a3d50 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575749.745632:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789575749.745644:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789575749.745827:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bd1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1319281b-72e3-49ea-9146-137043c48047+9:14418:x1876505676336640:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 1919us (2214us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789575749.745837:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00010000:00010000:2.0:1789575749.749473:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749507:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749550:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749567:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd3c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.749574:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749584:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749609:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9683773000) 00010000:00010000:2.0:1789575749.749614:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789575749.749621:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.749628:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3c00/0xc45cc82a2238462e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.751831:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.752426:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676336896 00000100:00100000:0.0:1789575749.752446:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676336896 00000100:00100000:0.0:1789575749.752550:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789575749.752574:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+8:14418:x1876505676336896:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789575749.753436:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+9:14418:x1876505676336896:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 859us (1620us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789575749.753449:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789575749.756774:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.757024:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676337152 00000100:00100000:2.0:1789575749.757139:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676337152 00000100:00100000:2.0:1789575749.757259:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789575749.757273:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+9:14418:x1876505676337152:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575749.757311:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575749.757338:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22384635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5eb5 expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757481:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757525:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757540:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757571:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757578:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.757584:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.758006:0:15386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789575749.758263:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758273:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758281:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758288:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.758294:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758303:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758331:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575749.758334:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.758340:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758347:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238463c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758363:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758399:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758406:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758412:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.758416:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758423:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758431:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e9687bd9d00) 00010000:00010000:2.0:1789575749.758433:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.758436:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758442:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384643 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758507:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22384635 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eb5 expref: 11 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758520:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575749.758522:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575749.758526:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a22384635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eb5 expref: 11 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.758536:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9800, rc 0) 00000100:00100000:2.0:1789575749.758640:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+10:14418:x1876505676337152:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1370us (1882us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789575749.758650:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789575749.761572:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.762663:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676337280 00000100:00100000:0.0:1789575749.762680:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676337280 00000100:00100000:0.0:1789575749.762771:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789575749.762787:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+10:14418:x1876505676337280:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789575749.762823:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575749.762858:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384651 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ebc expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.762994:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.763011:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.763058:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575749.763100:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789575749.763104:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575749.763128:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.763162:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384651 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 12 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.763185:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 11 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575749.763196:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9200) 00010000:00010000:0.0:1789575749.763200:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789575749.763204:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f2000, rc 0) 00000100:00100000:0.0:1789575749.763293:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1319281b-72e3-49ea-9146-137043c48047+11:14418:x1876505676337280:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 511us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575749.763301:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789575749.767258:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575749.768128:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676337408 00000100:00100000:0.0:1789575749.768145:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676337408 00000100:00100000:0.0:1789575749.768223:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789575749.768238:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+11:14418:x1876505676337408:12345-192.168.202.32@tcp:37:lfs.0 00000100:00100000:3.0:1789575749.773928:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1319281b-72e3-49ea-9146-137043c48047+11:14418:x1876505676337408:12345-192.168.202.32@tcp:37:lfs.0 Request processed in 5678us (6676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575749.773946:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789575749.779123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575749.779297:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676337664 00000100:00100000:3.0:1789575749.779334:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676337664 00000100:00100000:3.0:1789575749.779460:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789575749.779474:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969a771c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1319281b-72e3-49ea-9146-137043c48047+11:14418:x1876505676337664:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575749.779903:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969a771c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1319281b-72e3-49ea-9146-137043c48047+12:14418:x1876505676337664:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 430us (798us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789575749.779913:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00010000:00010000:0.0:1789575749.800634:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575749.844049:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.844337:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676337792 00000100:00100000:2.0:1789575749.844356:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676337792 00000100:00100000:2.0:1789575749.844502:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:2.0:1789575749.844516:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:14424:x1876505676337792:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575749.844547:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575749.844589:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238465f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ec3 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844687:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844705:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844721:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844750:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844759:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.844766:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845162:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22384674 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845173:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22384674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845307:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22384674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.845348:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789575749.845353:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575749.845443:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22384674 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845461:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845469:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845476:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845494:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.845500:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845508:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845523:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:2.0:1789575749.845527:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.845533:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845540:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845564:0:14300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845571:0:14300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845578:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845584:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.845588:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845595:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845613:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e9687bd9d00) 00010000:00010000:2.0:1789575749.845616:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.845620:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845626:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a2238466d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845669:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238465f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ec3 expref: 10 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845686:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8600/0xc45cc82a22384674 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ec3 expref: 9 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.845694:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9200) 00010000:00010000:2.0:1789575749.845696:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789575749.845698:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8600, rc 0) 00000100:00100000:2.0:1789575749.845785:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14424:x1876505676337792:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1271us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575749.845795:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789575749.851497:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.851637:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676338048 00000100:00100000:2.0:1789575749.851651:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676338048 00000100:00100000:2.0:1789575749.851729:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789575749.851741:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:14424:x1876505676338048:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575749.851773:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575749.851800:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238467b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5eca expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.852242:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.852262:0:15386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 11 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.852272:0:15386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.852317:0:15386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 11 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.852335:0:15386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 11 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.852351:0:15386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15386:1876505699402624:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789575749.852502:0:15386:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789575749.859345:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575749.859508:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676338176 00000100:00100000:1.0:1789575749.859524:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676338176 00010000:00010000:1.0:1789575749.859615:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 12 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575749.859676:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789575749.859689:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1319281b-72e3-49ea-9146-137043c48047+12:2358:x1876505676338176:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789575749.859712:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789575749.859719:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 12 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.859735:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 12 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.859763:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9200) 00010000:00010000:1.0:1789575749.859769:0:14285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.859782:0:14285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.859790:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575749.859814:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575749.860032:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1319281b-72e3-49ea-9146-137043c48047+12:2358:x1876505676338176:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 343us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575749.860041:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00010000:00010000:2.0:1789575749.860787:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2000/0xc45cc82a22384658 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ebc expref: 11 pid: 14300 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.860812:0:15386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15386:1876505699402624:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789575749.860849:0:15386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.860863:0:15386:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.860953:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.860986:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.861000:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.861011:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.864706:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865140:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865161:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.865244:0:15386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789575749.865299:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865309:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865318:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865326:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.865347:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865358:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865411:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9200) 00010000:00010000:2.0:1789575749.865415:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.865422:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865429:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384682 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575749.865447:0:15386:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fc2f085 reply state 000000001bd6e96e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575749.865461:0:15386:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789575749.865519:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a2238467b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 12 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865538:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 11 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.865547:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575749.865549:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789575749.865564:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8200, rc 0) 00000100:00100000:2.0:1789575749.865740:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+12:14424:x1876505676338048:12345-192.168.202.32@tcp:101:bash.0 Request processed in 13999us (14258us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789575749.865752:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00010000:00010000:2.0:1789575749.876060:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876086:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876094:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876101:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575749.876107:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876118:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876138:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e9687bd9d00) 00010000:00010000:2.0:1789575749.876141:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575749.876146:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.876153:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384689 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575749.879817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575749.879920:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676338304 00000100:00100000:2.0:1789575749.879935:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676338304 00000100:00100000:2.0:1789575749.880037:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789575749.880053:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+11:14424:x1876505676338304:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789575749.880087:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575749.880116:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238469e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ed1 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880248:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880265:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880280:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575749.880334:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789575749.880339:0:14300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789575749.880361:0:14300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880411:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880442:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238469e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 13 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880465:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 12 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575749.880476:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575749.880479:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575749.880483:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8e00, rc 0) 00000100:00100000:2.0:1789575749.880549:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+12:14424:x1876505676338304:12345-192.168.202.32@tcp:101:bash.0 Request processed in 499us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575749.880568:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789575749.885705:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575749.886228:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676338560 00000100:00100000:3.0:1789575749.886245:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676338560 00000100:00100000:3.0:1789575749.886348:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789575749.886366:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+12:14424:x1876505676338560:12345-192.168.202.32@tcp:35:bash.0 00000001:00080000:3.0:1789575749.886919:0:14303:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1789575749.887170:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:14424:x1876505676338560:12345-192.168.202.32@tcp:35:bash.0 Request processed in 806us (1477us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789575749.887182:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000020:00080000:3.0:1789575749.887190:0:14303:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789575750.003598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575750.004291:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676338816 00000100:00100000:1.0:1789575750.004314:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676338816 00000100:00100000:1.0:1789575750.004529:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:1.0:1789575750.004579:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:14434:x1876505676338816:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789575750.004624:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575750.004657:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a223846ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ed8 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575750.004806:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789575750.005048:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a223846ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed8 expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.005065:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9687dc9300) 00010000:00010000:1.0:1789575750.005069:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575750.005075:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a223846ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed8 expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.005110:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86a00, rc 0) 00000100:00100000:1.0:1789575750.005510:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+15:14434:x1876505676338816:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 935us (1928us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1789575750.005518:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789575750.011766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.011865:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676339072 00000100:00100000:3.0:1789575750.011890:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676339072 00000100:00100000:3.0:1789575750.011985:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789575750.011999:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+15:14434:x1876505676339072:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575750.012619:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:14434:x1876505676339072:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 620us (869us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789575750.012628:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789575750.067632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575750.067744:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676339328 00000100:00100000:2.0:1789575750.067762:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676339328 00000100:00100000:2.0:1789575750.067908:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789575750.067923:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:14437:x1876505676339328:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789575750.067966:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575750.067994:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a223846ba lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5edf expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.068154:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223846c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.068172:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223846c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.068366:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223846c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789575750.068432:0:14300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789575750.068657:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a223846ba lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5edf expref: 19 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.068681:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223846c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5edf expref: 18 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.068693:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.068697:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789575750.068702:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef9800, rc 0) 00000100:00100000:2.0:1789575750.068797:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:14437:x1876505676339328:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 877us (1183us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789575750.068832:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789575750.074608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575750.074688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.074780:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676339584 00000100:00100000:3.0:1789575750.074796:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676339584 00000100:00100000:3.0:1789575750.074906:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789575750.074920:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:2357:x1876505676339584:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575750.074965:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575750.074997:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9800/0xc45cc82a223846c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5edf expref: 18 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.075019:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:3.0:1789575750.075037:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575750.075410:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+17:2357:x1876505676339584:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 491us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575750.075420:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:2.0:1789575750.076928:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676339456 00000100:00100000:2.0:1789575750.076947:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676339456 00000100:00100000:2.0:1789575750.077166:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789575750.077244:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+17:14437:x1876505676339456:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:2.0:1789575750.077356:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077481:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077499:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077540:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077548:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077568:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077576:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575750.077583:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077592:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077605:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.077631:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789575750.077638:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.077645:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a223846cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575750.077807:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+17:14437:x1876505676339456:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 628us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.077818:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789575750.081957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.082129:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676339840 00000100:00100000:3.0:1789575750.082144:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676339840 00000100:00100000:3.0:1789575750.082321:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575750.082334:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+17:14437:x1876505676339840:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789575750.082731:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:14437:x1876505676339840:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 398us (866us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789575750.082740:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000040:00080000:2.0:1789575750.250867:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789575750.336058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.336202:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340096 00000100:00100000:3.0:1789575750.336216:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340096 00000100:00100000:3.0:1789575750.336427:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:3.0:1789575750.336442:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:14468:x1876505676340096:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:3.0:1789575750.336482:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575750.336527:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a223846d6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ee6 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.336703:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3000/0xc45cc82a223846dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.336756:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3000/0xc45cc82a223846dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.336775:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3000/0xc45cc82a223846dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789575750.336794:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789575750.337028:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a223846d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ee6 expref: 21 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.337054:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3000/0xc45cc82a223846dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ee6 expref: 20 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.337065:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:3.0:1789575750.337069:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789575750.337074:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd3000, rc 0) 00000100:00100000:3.0:1789575750.337179:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14468:x1876505676340096:12345-192.168.202.32@tcp:101:cat.0 Request processed in 741us (1134us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789575750.337188:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789575750.343857:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575750.344022:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575750.344196:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340480 00000100:00100000:2.0:1789575750.344220:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340480 00000100:00100000:2.0:1789575750.344319:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:2.0:1789575750.344333:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:2355:x1876505676340480:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575750.344359:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575750.344465:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3000/0xc45cc82a223846dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ee6 expref: 20 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.344499:0:14285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.345318:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575750.345460:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+19:2355:x1876505676340480:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1130us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.345468:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789575750.348500:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340352 00000100:00100000:0.0:1789575750.350789:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340352 00000100:00100000:0.0:1789575750.351980:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789575750.352000:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+19:14468:x1876505676340352:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:0.0:1789575750.352517:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14468:x1876505676340352:12345-192.168.202.32@tcp:35:cat.0 Request processed in 524us (8676us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789575750.352524:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:1.0:1789575750.414099:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575750.414206:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340736 00000100:00100000:0.0:1789575750.414232:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340736 00000100:00100000:0.0:1789575750.414311:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:0.0:1789575750.414322:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14474:x1876505676340736:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:0.0:1789575750.414355:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575750.414432:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223846eb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5eed expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414704:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414725:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 21 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414734:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414767:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414820:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.414837:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575750.414854:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc924000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1876505699402752:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575750.415002:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 21 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.415011:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 21 pid: 15386 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575750.415020:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc924e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1876505699402880:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575750.415047:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968b0d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789575750.418879:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575750.419021:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc924000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1876505699402752:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575750.419037:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc924e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14301:1876505699402880:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575750.419069:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575750.419586:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340864 00000100:00100000:1.0:1789575750.419586:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.419596:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340864 00000100:00100000:2.0:1789575750.419672:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676340992 00000100:00100000:2.0:1789575750.419677:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676340992 00010000:00010000:2.0:1789575750.419728:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 23 pid: 15386 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575750.419843:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00010000:00010000:3.0:1789575750.419849:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 23 pid: 14300 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575750.419855:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:2357:x1876505676340992:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575750.419877:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575750.419886:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 23 pid: 15386 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.419898:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 23 pid: 15386 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.419926:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8200/0xc45cc82a22384690 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eca expref: 23 pid: 15386 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.419946:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.419952:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.419962:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.419969:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575750.420043:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:2357:x1876505676340992:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 189us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.420051:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789575750.420072:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789575750.420098:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96c128c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+21:2357:x1876505676340864:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575750.420117:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575750.420123:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420136:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420148:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a223846a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ed1 expref: 21 pid: 14300 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420159:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.420163:0:14287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420172:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420182:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.420213:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575750.420233:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96c128c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:2357:x1876505676340864:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 155us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.420241:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00010000:00010000:0.0:1789575750.420545:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575750.420586:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575750.420616:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789575750.420875:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3800/0xc45cc82a223846eb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eed expref: 21 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575750.420898:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87600/0xc45cc82a223846f2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5eed expref: 20 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575750.420907:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:0.0:1789575750.420911:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789575750.420915:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87600, rc 0) 00000100:00100000:0.0:1789575750.420962:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14474:x1876505676340736:12345-192.168.202.32@tcp:101:dd.0 Request processed in 6641us (6898us total) trans 8589934609 rc 0/0 00000100:00100000:0.0:1789575750.420971:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:1.0:1789575750.426691:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575750.426911:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676341248 00000100:00100000:2.0:1789575750.426924:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676341248 00000100:00100000:2.0:1789575750.427038:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789575750.427050:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14474:x1876505676341248:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:2.0:1789575750.427495:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.427530:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.427544:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789575750.427618:0:14300:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1789575750.427645:0:14300:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080d175a0 reply state 0000000015e10c1c transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575750.427656:0:14300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575750.427777:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14474:x1876505676341248:12345-192.168.202.32@tcp:36:dd.0 Request processed in 728us (1106us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789575750.427785:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000020:00080000:2.0:1789575750.427790:0:14300:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789575750.431947:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.431973:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.431982:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.431988:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575750.431995:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432004:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432061:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.432064:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575750.432070:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432077:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9600/0xc45cc82a22384700 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575750.432192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575750.432316:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676341376 00000100:00100000:2.0:1789575750.432331:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676341376 00000100:00100000:2.0:1789575750.432419:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:2.0:1789575750.432431:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:14474:x1876505676341376:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:2.0:1789575750.432461:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575750.432485:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384707 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5ef4 expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432673:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384707 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ef4 expref: 23 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432689:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384707 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ef4 expref: 23 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.432706:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.432709:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789575750.432711:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8400, rc 0) 00000100:00100000:2.0:1789575750.432825:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14474:x1876505676341376:12345-192.168.202.32@tcp:101:dd.0 Request processed in 396us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.432833:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:0.0:1789575750.448691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575750.449450:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676341632 00000100:00100000:2.0:1789575750.449469:0:14287:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676341632 00000100:00100000:2.0:1789575750.449598:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:2.0:1789575750.449613:0:14287:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14474:x1876505676341632:12345-192.168.202.32@tcp:103:dd.0 00010000:00010000:2.0:1789575750.449641:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575750.449683:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8400/0xc45cc82a22384707 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5ef4 expref: 23 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575750.449712:0:14287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575750.449719:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575750.449805:0:14287:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:14474:x1876505676341632:12345-192.168.202.32@tcp:103:dd.0 Request processed in 195us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.449813:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789575750.452711:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575750.453068:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676341760 00000100:00100000:3.0:1789575750.453091:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676341760 00000100:00100000:3.0:1789575750.453181:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:3.0:1789575750.453195:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:14474:x1876505676341760:12345-192.168.202.32@tcp:58:dd.0 00010000:00010000:3.0:1789575750.453368:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.453430:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575750.453449:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789575750.454772:0:14302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789575750.460697:0:14302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789575750.460839:0:14302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789575750.461023:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:14474:x1876505676341760:12345-192.168.202.32@tcp:58:dd.0 Request processed in 7820us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575750.461039:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789575750.467517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575750.471100:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676341888 00000100:00100000:1.0:1789575750.471121:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676341888 00000100:00100000:1.0:1789575750.471229:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789575750.471242:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+22:14474:x1876505676341888:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789575750.471271:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575750.471301:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5efb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471425:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471437:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 23 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471462:0:14301:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471478:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 23 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471494:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:1.0:1789575750.471497:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789575750.471502:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 23 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575750.471509:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe86a00, rc 0) 00000100:00100000:1.0:1789575750.471616:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14474:x1876505676341888:12345-192.168.202.32@tcp:101:dd.0 Request processed in 376us (4113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575750.471644:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00010000:00010000:0.0:1789575750.824813:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575751.082177:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699403008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575751.082297:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575751.084014:0:14988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699403008 00000100:00100000:3.0:1789575751.084031:0:14988:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699403008 00000100:00100000:3.0:1789575751.084132:0:14988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789575751.084154:0:14988:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699403008:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789575751.084223:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789575751.084425:0:14988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575751.084533:0:14988:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699403008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 390us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.084552:0:14988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789575751.084682:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699403008:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789575751.272795:0:14334:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789575751.272808:0:14334:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789575751.272900:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789575751.272991:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789575751.273182:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14334:1876505699403136:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789575751.273754:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789575751.286121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.286287:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342016 00000100:00100000:1.0:1789575751.286301:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342016 00000100:00100000:1.0:1789575751.286431:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789575751.286444:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342016:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789575751.286580:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342016:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 Request processed in 138us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575751.286590:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00080000:0.0:1789575751.287985:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789575751.289512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575751.290149:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342144 00000100:00100000:3.0:1789575751.290167:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342144 00000100:00100000:3.0:1789575751.290284:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789575751.290296:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342144:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789575751.290331:0:14300:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789575751.290711:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbd06680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14334:1876505699403136:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789575751.294133:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14475:x1876505676342144:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 3819us (4613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.294155:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:1.0:1789575751.306499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.307451:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342272 00000100:00100000:0.0:1789575751.307468:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342272 00000100:00100000:0.0:1789575751.307560:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:0.0:1789575751.307572:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14475:x1876505676342272:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789575751.307654:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.307676:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308021:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308096:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308106:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308113:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308138:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308147:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308153:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575751.308220:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789575751.308225:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575751.308239:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308250:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308256:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308262:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308268:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3a00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575751.308272:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308280:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308293:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9687dc9100) 00010000:00010000:0.0:1789575751.308296:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575751.308302:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308308:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3a00/0xc45cc82a2238471c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308322:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308341:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308348:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308353:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575751.308356:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308363:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308428:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575751.308431:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575751.308434:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308441:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384723 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308458:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308464:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308470:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308474:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575751.308483:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308489:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308497:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:0.0:1789575751.308500:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575751.308503:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.308508:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238472a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575751.308601:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14475:x1876505676342272:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 1029us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575751.308610:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:0.0:1789575751.314644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.315005:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342528 00000100:00100000:1.0:1789575751.315019:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342528 00000100:00100000:1.0:1789575751.315094:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:1.0:1789575751.315105:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+23:14475:x1876505676342528:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789575751.315127:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575751.315149:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a22384731 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f02 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315270:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315285:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315297:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789575751.315310:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789575751.315482:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315491:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315498:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315504:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575751.315508:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315516:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315531:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:1.0:1789575751.315534:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789575751.315552:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315558:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a22384738 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315612:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a22384731 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f02 expref: 25 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315624:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9687dc9100) 00010000:00010000:1.0:1789575751.315626:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789575751.315630:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a22384731 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f02 expref: 25 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.315655:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87400, rc 0) 00000100:00100000:1.0:1789575751.316168:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342528:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1062us (1532us total) trans 8589934612 rc 301/301 00000100:00100000:1.0:1789575751.316178:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:1.0:1789575751.326030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.327795:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342656 00000100:00100000:2.0:1789575751.327815:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342656 00000100:00100000:2.0:1789575751.327930:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:2.0:1789575751.327943:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342656:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789575751.327988:0:15386:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789575751.328143:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342656:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 201us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.328152:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789575751.344196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.344314:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676342912 00000100:00100000:1.0:1789575751.344326:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676342912 00000100:00100000:1.0:1789575751.344973:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:1.0:1789575751.344988:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+24:14475:x1876505676342912:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789575751.345016:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789575751.345042:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a22384746 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f09 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789575751.346117:0:14302:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1789575751.346126:0:14302:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1789575751.346183:0:14302:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789575751.348677:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a2238474d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.349051:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a2238474d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.349071:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a2238474d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.349146:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a22384746 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f09 expref: 27 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.349191:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a2238474d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f09 expref: 26 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.349201:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e96831e1b00) 00010000:00010000:1.0:1789575751.349204:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789575751.349208:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bbe87000, rc 0) 00000100:00100000:1.0:1789575751.349303:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbcab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+26:14475:x1876505676342912:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4318us (5120us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789575751.349312:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789575751.358676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.358869:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676343168 00000100:00100000:0.0:1789575751.358882:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676343168 00000100:00100000:0.0:1789575751.358961:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:0.0:1789575751.358973:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+26:14475:x1876505676343168:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789575751.359050:0:15386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789575751.359083:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a2238474d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f09 expref: 26 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359106:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e96831e1b00) 00010000:00010000:0.0:1789575751.359118:0:15386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789575751.359163:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359181:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359193:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359251:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359279:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359286:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359353:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359360:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359367:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359422:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2600 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575751.359427:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359435:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359453:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e9687dc9200) 00010000:00010000:0.0:1789575751.359456:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575751.359460:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359467:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a2238475b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359477:0:15386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359484:0:15386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359489:0:15386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359494:0:15386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3200 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:0.0:1789575751.359497:0:15386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359502:0:15386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359509:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x41f37743 (ffff8e9687dc9a00) 00010000:00010000:0.0:1789575751.359511:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789575751.359514:0:15386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.359519:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3200/0xc45cc82a22384762 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x41f37743 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575751.359619:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+25:14475:x1876505676343168:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 648us (954us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789575751.359628:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789575751.361926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575751.362010:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676343296 00000100:00100000:3.0:1789575751.362021:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676343296 00000100:00100000:3.0:1789575751.362144:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:3.0:1789575751.362155:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+25:14475:x1876505676343296:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575751.362178:0:14300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575751.362207:0:14300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22384769 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f10 expref: -99 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362244:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22384770 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362258:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22384770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362270:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22384770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362425:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd3200/0xc45cc82a22384769 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f10 expref: 27 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362446:0:14300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2600/0xc45cc82a22384770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f10 expref: 26 pid: 14300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.362454:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575751.362458:0:14300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789575751.362462:0:14300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2600, rc 0) 00000100:00100000:3.0:1789575751.362514:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+26:14475:x1876505676343296:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 362us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.362522:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789575751.371638:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.372284:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676343552 00000100:00100000:2.0:1789575751.372294:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676343552 00000100:00100000:2.0:1789575751.372572:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:2.0:1789575751.372587:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+26:14475:x1876505676343552:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575751.372964:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.372986:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.373001:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789575751.378061:0:15386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789575751.378099:0:15386:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 563464725964ns, next at 564464719719ns, rc = 0 00000004:00010000:2.0:1789575751.378270:0:15386:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7cf8ecd reply state 0000000063696f17 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575751.378286:0:15386:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575751.379638:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+28:14475:x1876505676343552:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 7045us (8002us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789575751.379671:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:2.0:1789575751.391123:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:1.0:1789575751.391408:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391424:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391434:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391441:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef8e00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:1.0:1789575751.391446:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391455:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391472:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:1.0:1789575751.391476:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789575751.391481:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.391507:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef8e00/0xc45cc82a22384777 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.391739:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676343680 00000100:00100000:3.0:1789575751.391750:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676343680 00000100:00100000:3.0:1789575751.391821:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:3.0:1789575751.391833:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+27:14475:x1876505676343680:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789575751.391873:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789575751.391896:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f17 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.391967:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 28 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.391982:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 28 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.392003:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575751.392006:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789575751.392009:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bcdd2e00, rc 0) 00000100:00100000:3.0:1789575751.392087:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+28:14475:x1876505676343680:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 256us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.392096:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:3.0:1789575751.395287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.395549:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676343808 00000100:00100000:2.0:1789575751.395564:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676343808 00000100:00100000:2.0:1789575751.395659:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789575751.395671:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2356:x1876505676343808:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789575751.396612:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789575751.398696:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2356:x1876505676343808:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 3016us (3410us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789575751.398709:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789575751.402135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.402495:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344064 00000100:00100000:0.0:1789575751.402513:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344064 00000100:00100000:0.0:1789575751.402598:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789575751.402610:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+28:14475:x1876505676344064:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789575751.403273:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+29:14475:x1876505676344064:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 662us (1153us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789575751.403284:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789575751.408119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.412576:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344320 00000100:00100000:1.0:1789575751.412596:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344320 00000100:00100000:2.0:1789575751.416185:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789575751.416203:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+29:14475:x1876505676344320:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789575751.416409:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+29:14475:x1876505676344320:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 170us (8265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.416420:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789575751.423156:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.429819:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344448 00000100:00100000:0.0:1789575751.429838:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344448 00000100:00100000:0.0:1789575751.429950:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789575751.429960:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+29:14475:x1876505676344448:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575751.429982:0:15386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575751.430006:0:15386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384785 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f1e expref: -99 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430087:0:15386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430102:0:15386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430135:0:15386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789575751.430181:0:15386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789575751.430204:0:15386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430233:0:15386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f2600/0xc45cc82a22384785 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f1e expref: 31 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430251:0:15386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f1e expref: 30 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.430260:0:15386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575751.430264:0:15386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789575751.430268:0:15386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f3e00, rc 0) 00000100:00100000:0.0:1789575751.430347:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+30:14475:x1876505676344448:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 388us (7202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575751.430354:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:1.0:1789575751.452603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.452925:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344576 00000100:00100000:2.0:1789575751.452941:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344576 00000100:00100000:2.0:1789575751.453018:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789575751.453029:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+6:2357:x1876505676344576:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789575751.453049:0:14987:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789575751.453071:0:14987:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f25 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789575751.453101:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaac247, blocks: 0x1 00010000:00010000:2.0:1789575751.453123:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=563s v=(0 0) 00010000:00010000:2.0:1789575751.453145:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575751.453154:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.453176:0:14987:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 7 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.453190:0:14987:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9687ef8200, rc 0) 00000100:00100000:2.0:1789575751.453257:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2357:x1876505676344576:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 230us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.453264:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575751.461290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.461417:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344832 00000100:00100000:2.0:1789575751.461429:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344832 00000100:00100000:2.0:1789575751.461503:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789575751.461515:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+30:14475:x1876505676344832:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789575751.461654:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+30:14475:x1876505676344832:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.461662:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789575751.464941:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.465136:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676344960 00000100:00100000:0.0:1789575751.465149:0:14301:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676344960 00000100:00100000:0.0:1789575751.465694:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789575751.465724:0:14301:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+30:14475:x1876505676344960:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789575751.542935:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:1.0:1789575751.542967:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000004:00080000:1.0:1789575751.543006:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789575751.543046:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1789575751.543082:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789575751.543314:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789575751.543341:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699403264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789575751.543462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575751.543569:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699403264 00000100:00100000:3.0:1789575751.543580:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699403264 00000100:00100000:3.0:1789575751.543825:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789575751.543839:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699403264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789575751.544083:0:14985:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789575751.544087:0:14985:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789575751.544089:0:14985:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789575751.544091:0:14985:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789575751 -> 1789575751 00002000:00010000:3.0:1789575751.544094:0:14985:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789575751.544142:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876505699403264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (681us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789575751.544150:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789575751.544247:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e96913fb800/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789575751.544255:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96913fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699403264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789575751.544402:0:14301:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:14475:x1876505676344960:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 78651us (79444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.544412:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:3.0:1789575751.550499:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.550654:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345088 00000100:00100000:2.0:1789575751.550677:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345088 00000100:00100000:2.0:1789575751.550790:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789575751.550803:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2358:x1876505676345088:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789575751.550968:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96913f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2358:x1876505676345088:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 167us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.550976:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:3.0:1789575751.557056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.557164:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345344 00000100:00100000:2.0:1789575751.557183:0:14300:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345344 00000100:00100000:2.0:1789575751.557257:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789575751.557264:0:14300:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:14475:x1876505676345344:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789575751.557344:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575751.557401:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bb2f3e00/0xc45cc82a2238478c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f1e expref: 14 pid: 15386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.557421:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575751.557428:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789575751.557466:0:14300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.557483:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.557495:0:14300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789575751.557757:0:14300:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000151df07d reply state 000000008bb6458f transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575751.557766:0:14300:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789575751.557867:0:14300:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+15:14475:x1876505676345344:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 602us (830us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789575751.557872:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00010000:00010000:3.0:1789575751.561159:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561183:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561191:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561197:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:3.0:1789575751.561202:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561235:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561256:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:3.0:1789575751.561260:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789575751.561266:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.561273:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a2238479a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14300 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.565005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.565192:0:14985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345472 00000100:00100000:0.0:1789575751.565216:0:14985:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345472 00000100:00100000:0.0:1789575751.565321:0:14985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789575751.565334:0:14985:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:14475:x1876505676345472:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789575751.565504:0:14985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789575751.565531:0:14985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x23aaa7fb8bae5f2c expref: -99 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.565586:0:14985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.565597:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575751.565603:0:14985:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575751.565608:0:14985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.565655:0:14985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 8 pid: 14987 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.565672:0:14985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 8 pid: 14987 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575751.565688:0:14985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14985:1876505699403392:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789575751.565815:0:14985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968653ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575751.575237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575751.575319:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345600 00000100:00100000:3.0:1789575751.575330:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345600 00010000:00010000:3.0:1789575751.575418:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 9 pid: 14987 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.575461:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575751.575471:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:2358:x1876505676345600:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575751.575486:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575751.575512:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 9 pid: 14987 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.575528:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 9 pid: 14987 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.575571:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575751.575596:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575751.575605:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.575617:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.575667:0:14286:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.575705:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14286:1876505699403520:192.168.202.32@tcp:105: 00000100:00100000:3.0:1789575751.575802:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789575751.578228:0:14985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb28538/0xc45cc82a22384793 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f25 expref: 9 pid: 14987 timeout: 663 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575751.578264:0:14985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14985:1876505699403392:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789575751.578862:0:14985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.578910:0:14985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e96bb2f2600, rc 0) 00000100:00100000:0.0:1789575751.579200:0:14985:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9585826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:14475:x1876505676345472:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 13866us (14202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575751.579211:0:14985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:1.0:1789575751.583079:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc238a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14286:1876505699403520:192.168.202.32@tcp:105: 00010000:00010000:1.0:1789575751.583124:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789575751.583214:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2358:x1876505676345600:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 7744us (7987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575751.583226:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789575751.591220:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.591725:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345728 00000100:00100000:2.0:1789575751.591743:0:14987:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345728 00000100:00100000:2.0:1789575751.591831:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789575751.591862:0:14987:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2358:x1876505676345728:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789575751.592150:0:14987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789575751.592154:0:14987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789575750 00002000:00010000:2.0:1789575751.592157:0:14987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789575749 00002000:00010000:2.0:1789575751.592159:0:14987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789575751 -> 1789575750 00002000:00010000:2.0:1789575751.592162:0:14987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789575751.592533:0:14987:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:2358:x1876505676345728:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 668us (1317us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789575751.592557:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789575751.597842:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.597978:0:14986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345856 00000100:00100000:0.0:1789575751.597997:0:14986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345856 00000100:00100000:0.0:1789575751.598118:0:14986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575751.598131:0:14986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:2355:x1876505676345856:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789575751.598201:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.598228:0:14986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.598238:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575751.598243:0:14986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789575751.598249:0:14986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.598297:0:14986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 8 pid: 14985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.598314:0:14986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 8 pid: 14985 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575751.598359:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14986:1876505699403648:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575751.598662:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e968653ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789575751.602367:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.603020:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bbca8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14986:1876505699403648:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789575751.603067:0:14986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.604529:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676345984 00000100:00100000:3.0:1789575751.604556:0:14285:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676345984 00010000:00010000:3.0:1789575751.604618:0:14285:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.604673:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789575751.604684:0:14285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:2358:x1876505676345984:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789575751.604701:0:14285:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789575751.604734:0:14285:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.604747:0:14285:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.604799:0:14285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f2c expref: 9 pid: 14985 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.604819:0:14285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575751.604823:0:14285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789575751.604829:0:14285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.604840:0:14285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.605342:0:14285:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789575751.605464:0:14285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+8:2358:x1876505676345984:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 780us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575751.605473:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00010000:00010000:1.0:1789575751.607661:0:14986:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607681:0:14986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607735:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607743:0:14986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607752:0:14986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607759:0:14986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575751.607763:0:14986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607772:0:14986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607796:0:14986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.607804:0:14986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575751.608869:0:14986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbd07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2355:x1876505676345856:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 10722us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575751.608898:0:14986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789575751.612434:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575751.612504:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676346240 00000100:00100000:1.0:1789575751.612515:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676346240 00000100:00100000:1.0:1789575751.612582:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:1.0:1789575751.612591:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:14475:x1876505676346240:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789575751.612674:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612692:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612705:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612947:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612958:0:14302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 15 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612965:0:14302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.612996:0:14302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 15 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.613010:0:14302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 15 pid: 14302 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575751.613049:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc926300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14302:1876505699403776:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789575751.613868:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9699eeb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575751.619095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.619128:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676346368 00000100:00100000:2.0:1789575751.619139:0:14286:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676346368 00010000:00010000:2.0:1789575751.619184:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 16 pid: 14302 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575751.619220:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789575751.619229:0:14286:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:2357:x1876505676346368:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789575751.619243:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789575751.619249:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 16 pid: 14302 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.619262:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 16 pid: 14302 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.619284:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575751.619305:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.619315:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.619323:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.619341:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789575751.619422:0:14286:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:2357:x1876505676346368:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 193us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.619430:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:3.0:1789575751.620042:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2e00/0xc45cc82a2238477e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5f17 expref: 15 pid: 14302 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575751.620062:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc926300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14302:1876505699403776:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789575751.620093:0:14302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.620104:0:14302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.620123:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575751.620411:0:14302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789575751.620575:0:14302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:3.0:1789575751.620623:0:14302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789575751.620705:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc9c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14302:1876505699403904:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789575751.620756:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575751.620782:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9686bb1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789575751.621033:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699403904 00000100:00100000:2.0:1789575751.621040:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699403904 00000100:00100000:2.0:1789575751.621092:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789575751.621102:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14302:x1876505699403904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789575751.621180:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14302:x1876505699403904:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789575751.621186:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789575751.621571:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc9c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14302:1876505699403904:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789575751.624269:0:14302:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1789575751.624474:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e96bc416d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14302:1876505699404032:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789575751.624571:0:14302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789575751.624664:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789575751.624726:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404032 00000100:00100000:1.0:1789575751.624735:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404032 00000100:00100000:1.0:1789575751.624832:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789575751.624844:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14302:x1876505699404032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789575751.625228:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14302:x1876505699404032:12345-0@lo:1000:mdt00_002.0 Request processed in 385us (656us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789575751.625235:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789575751.625322:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e96bc416d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14302:1876505699404032:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789575751.625366:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625398:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625417:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625424:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575751.625429:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625437:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625453:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:2.0:1789575751.625456:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789575751.625461:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625466:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87400/0xc45cc82a223847b6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625498:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625504:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625509:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625514:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2400 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575751.625516:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625529:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625548:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575751.625550:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789575751.625558:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625569:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625578:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.625632:0:14302:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe86a00/0xc45cc82a22384715 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0x23aaa7fb8bae5efb expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575751.625645:0:14302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e968660f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14302:1876505699404160:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789575751.625718:0:14302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e9683cb96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789575751.631263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.631354:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676346496 00000100:00100000:0.0:1789575751.631365:0:14303:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676346496 00000100:00100000:0.0:1789575751.631578:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789575751.631591:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e969a796c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+19:14474:x1876505676346496:12345-192.168.202.32@tcp:49:dd.0 00000100:00100000:0.0:1789575751.631746:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e969a796c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+19:14474:x1876505676346496:12345-192.168.202.32@tcp:49:dd.0 Request processed in 157us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575751.631755:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789575751.634244:0:14302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e968660f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14302:1876505699404160:192.168.202.32@tcp:105: 00010000:00010000:3.0:1789575751.634277:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575751.634288:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bcdd2400/0xc45cc82a2238470e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634457:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634474:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634486:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634516:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634524:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634530:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634535:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9c00 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575751.634547:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634556:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634574:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575751.634577:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789575751.634581:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634586:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9687ef9c00/0xc45cc82a223847bd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634597:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634602:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634607:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634620:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87000 already unused, calling callback (ffffffffc221c4f0) 00010000:00010000:2.0:1789575751.634623:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634629:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634636:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e9687bd9500) 00010000:00010000:2.0:1789575751.634638:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789575751.634641:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575751.634646:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575751.634927:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:14475:x1876505676346240:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 22334us (22500us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789575751.634937:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000020:00080000:2.0:1789575751.634944:0:14302:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789575751.635121:0:14334:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789575751.635126:0:14334:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789575751.635153:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789575751.635161:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789575751.642136:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575751.642463:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676346752 00000100:00100000:3.0:1789575751.642478:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676346752 00000100:00100000:0.0:1789575751.642593:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789575751.642608:0:14303:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+18:14475:x1876505676346752:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789575751.644301:0:14303:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789575751.651009:0:14303:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:1.0:1789575751.651215:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651233:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651244:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651253:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651259:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651265:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.651288:0:14303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789575751.651455:0:14288:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789575751.651464:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.651471:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575751.651475:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575751.651738:0:14303:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:14475:x1876505676346752:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 9128us (9609us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789575751.651748:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000020:00080000:1.0:1789575751.651755:0:14303:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789575751.651814:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.651844:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e9683773200) 00010000:00010000:0.0:1789575751.651847:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789575751.651854:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.651870:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e96bbe87000/0xc45cc82a223847c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.651886:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575751.651888:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575751.651890:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789575751.847948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.848058:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676346880 00000100:00100000:0.0:1789575751.848072:0:14990:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676346880 00000100:00100000:0.0:1789575751.848151:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789575751.848163:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2358:x1876505676346880:12345-192.168.202.32@tcp:4:dd.0 00002000:00010000:0.0:1789575751.848216:0:14990:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aaac246, atime: 0x6aaac245, ctime: 0x6aaac246, blocks: 0x1 00010000:00010000:0.0:1789575751.848225:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.848242:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=563s v=(0 0) 00010000:00010000:0.0:1789575751.848247:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575751.848253:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.848268:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575751.849981:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789575751.867920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575751.868017:0:14992:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789575751.868028:0:14992:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789575751.868326:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347008 00000100:00100000:0.0:1789575751.868337:0:14992:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347008 00000100:00100000:2.0:1789575751.869254:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789575751.869293:0:14991:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789575751.869305:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347136 00000100:00100000:2.0:1789575751.869311:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347136 00000100:00100000:1.0:1789575751.870557:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789575751.870570:0:16533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+10:2357:x1876505676347136:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:1.0:1789575751.870608:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.870627:0:16533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575751.870632:0:16533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789575751.870638:0:16533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575751.870654:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789575752.059365:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1789575752.059421:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1789575752.059440:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1789575752.059505:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1789575752.059521:0:14990:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789575750 -> 1789575751 00002000:00010000:2.0:1789575752.059525:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1789575752.059555:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059595:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059604:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059613:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575752.059621:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059633:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059664:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059674:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aeb7623/0xc45cc82a223847cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575752.059823:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+10:2358:x1876505676346880:12345-192.168.202.32@tcp:4:dd.0 Request processed in 211655us (212448us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789575752.059836:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:2.0:1789575752.059882:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:2.0:1789575752.059897:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:2356:x1876505676347008:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:2.0:1789575752.059933:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059956:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789575752.059961:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789575752.059969:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.059982:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789575752.148034:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1789575752.160875:0:16533:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:1.0:1789575752.160972:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.160989:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.161000:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.161099:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bbe87400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575752.161107:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.161118:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.161142:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.161151:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b4cf2e/0xc45cc82a223847d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575752.161315:0:16533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+9:2357:x1876505676347136:12345-192.168.202.32@tcp:4:dd.0 Request processed in 290739us (292056us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789575752.161325:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:3.0:1789575752.177661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575752.177707:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575752.177729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789575752.184983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575752.188995:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347264 00000100:00100000:0.0:1789575752.189019:0:14992:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347264 00000100:00100000:0.0:1789575752.189099:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347392 00000100:00100000:0.0:1789575752.189103:0:14992:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347392 00000100:00100000:0.0:1789575752.189119:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347520 00000100:00100000:0.0:1789575752.189122:0:14992:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347520 00000100:00100000:0.0:1789575752.189144:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789575752.189154:0:14992:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+11:2355:x1876505676347264:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:0.0:1789575752.189199:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.189222:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.189227:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.189234:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.189263:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575752.190490:0:14991:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789575752.190503:0:14991:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789575752.190865:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347648 00000100:00100000:0.0:1789575752.190873:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347648 00000100:00100000:2.0:1789575752.191733:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789575752.192727:0:14991:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789575752.192747:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347776 00000100:00100000:0.0:1789575752.192758:0:14991:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347776 00000100:00100000:0.0:1789575752.192896:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789575752.192908:0:16535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:68701ed1-8a58-4b10-b854-0f15bbb165d2+14:2356:x1876505676347392:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:0.0:1789575752.192955:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.192977:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.192982:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.192991:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.193009:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575752.230662:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789575752.232792:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:0.0:1789575752.232806:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789575752.232823:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232838:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232903:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232913:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9687ef9600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575752.232937:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232947:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232974:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.232982:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a1817f/0xc45cc82a223847d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575752.233146:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:2356:x1876505676347008:12345-192.168.202.32@tcp:4:dd.0 Request processed in 173249us (366105us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789575752.233157:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789575752.233197:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789575752.233208:0:14990:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+15:2355:x1876505676347520:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:0.0:1789575752.233239:0:14990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.233252:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.233256:0:14990:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.233263:0:14990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.233276:0:14990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789575752.295285:0:16535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789575752.295296:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789575752.295312:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295337:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295347:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295355:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2600 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575752.295360:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295390:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295423:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295431:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be033cd7/0xc45cc82a223847e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575752.295546:0:16535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:68701ed1-8a58-4b10-b854-0f15bbb165d2+17:2356:x1876505676347392:12345-192.168.202.32@tcp:4:dd.0 Request processed in 102624us (117821us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789575752.295576:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789575752.295619:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789575752.295632:0:16535:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:68701ed1-8a58-4b10-b854-0f15bbb165d2+16:2356:x1876505676347648:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:0.0:1789575752.295669:0:16535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295682:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.295686:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789575752.295692:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.295704:0:16535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789575752.296185:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:3.0:1789575752.296208:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:3.0:1789575752.296278:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296296:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296305:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296313:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:3.0:1789575752.296326:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296336:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296351:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296358:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ef96e5/0xc45cc82a223847e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789575752.296452:0:14992:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+12:2355:x1876505676347264:12345-192.168.202.32@tcp:4:dd.0 Request processed in 107297us (118801us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789575752.296469:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789575752.296492:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789575752.296501:0:14992:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e968660e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+11:2355:x1876505676347776:12345-192.168.202.32@tcp:4:dd.0 00010000:00010000:3.0:1789575752.296519:0:14992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296545:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575752.296548:0:14992:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789575752.296553:0:14992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789575752.296567:0:14992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575752.334447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334544:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334583:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789575752.334609:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676348032 00000100:00100000:1.0:1789575752.334621:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676348032 00000100:00100000:1.0:1789575752.334671:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676348288 00000100:00100000:1.0:1789575752.334674:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676348288 00000100:00100000:1.0:1789575752.334719:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:1.0:1789575752.334730:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:2357:x1876505676348032:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575752.334974:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+20:2357:x1876505676348032:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 244us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575752.334982:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:1.0:1789575752.335001:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:1.0:1789575752.335008:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:2357:x1876505676348288:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789575752.335031:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1319281b-72e3-49ea-9146-137043c48047+6:2357:x1876505676348288:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575752.335037:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789575752.335163:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676347904 00000100:00100000:0.0:1789575752.335167:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676347904 00000100:00100000:0.0:1789575752.335197:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:0.0:1789575752.335204:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2357:x1876505676347904:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575752.335231:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5eb10d71-3a0e-4817-a234-1e8fbc839dd4+13:2357:x1876505676347904:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575752.335237:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:0.0:1789575752.335265:0:16494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676348160 00000100:00100000:0.0:1789575752.335269:0:16494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676348160 00000100:00100000:0.0:1789575752.335294:0:16494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676348416 00000100:00100000:0.0:1789575752.335298:0:16494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676348416 00000100:00100000:0.0:1789575752.335312:0:16494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505676348544 00000100:00100000:0.0:1789575752.335333:0:16494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505676348544 00000100:00100000:0.0:1789575752.335353:0:16494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789575752.335360:0:16494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676348160:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575752.335509:0:16494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2357:x1876505676348160:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 148us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575752.335517:0:16494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789575752.335541:0:16494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575752.335549:0:16494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676348416:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575752.335572:0:16494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676348416:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575752.335578:0:16494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789575752.335588:0:16494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789575752.335595:0:16494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676348544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789575752.335614:0:16494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1319281b-72e3-49ea-9146-137043c48047+5:2357:x1876505676348544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789575752.335620:0:16494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00080000:0.0:1789575752.335640:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789575752.335644:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789575752.335647:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789575752.359954:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1789575752.360932:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1789575752.360941:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1789575752.360958:0:14990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.360972:0:14990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.360980:0:14990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.360988:0:14990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f3e00 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:1.0:1789575752.360993:0:14990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.361002:0:14990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.361104:0:14990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789575752.361111:0:14990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7eac7d8/0xc45cc82a223847ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789575752.361215:0:14990:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68701ed1-8a58-4b10-b854-0f15bbb165d2+13:2355:x1876505676347520:12345-192.168.202.32@tcp:4:dd.0 Request processed in 128005us (183479us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789575752.361227:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000001:00080000:3.0:1789575752.452944:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:3.0:1789575752.452984:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1789575752.453165:0:16535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1789575752.453184:0:16535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453198:0:16535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453225:0:16535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453233:0:16535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bb2f2000 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:0.0:1789575752.453238:0:16535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453248:0:16535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.453252:0:14992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.453266:0:14992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.453273:0:14992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453395:0:16535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789575752.453405:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068708694/0xc45cc82a223847f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789575752.453616:0:16535:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:68701ed1-8a58-4b10-b854-0f15bbb165d2+7:2356:x1876505676347648:12345-192.168.202.32@tcp:4:dd.0 Request processed in 157981us (268638us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789575752.453627:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00010000:00010000:2.0:1789575752.455882:0:14992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e96bcdd2400 already unused, calling callback (ffffffffc17df8b0) 00010000:00010000:2.0:1789575752.455895:0:14992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.455912:0:14992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.455936:0:14992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789575752.455965:0:14992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007908b1fb/0xc45cc82a223847fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789575752.456074:0:14992:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e968660e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68701ed1-8a58-4b10-b854-0f15bbb165d2+5:2355:x1876505676347776:12345-192.168.202.32@tcp:4:dd.0 Request processed in 159570us (264346us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789575752.456085:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000040:00080000:0.0:1789575752.680902:0:14334:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789575752.680923:0:14334:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789575752.681285:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789575752.681293:0:14334:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789575752.874066:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575753.640617:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699404288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789575753.640904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789575753.645800:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699404544:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.645875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575753.646040:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699404416:0@lo:400:kworker.0 00000100:00100000:1.0:1789575753.646089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575753.646130:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699404928:0@lo:400:kworker.0 00000100:00100000:1.0:1789575753.646161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575753.646207:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404416 00000100:00100000:1.0:1789575753.646215:0:14292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404416 00000100:00100000:1.0:1789575753.646270:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789575753.646280:0:14292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bcdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699404416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.646299:0:16494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404544 00000100:00100000:3.0:1789575753.646305:0:16494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404544 00000100:00100000:1.0:1789575753.646336:0:14292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bcdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75adfecc-338c-4204-8932-8d3be75fd826+19:3308:x1876505699404416:12345-0@lo:400:kworker.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575753.646344:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789575753.646367:0:16494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789575753.646405:0:15386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404928 00000100:00100000:1.0:1789575753.646410:0:15386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404928 00000100:00100000:1.0:1789575753.646438:0:15386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789575753.646445:0:15386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699404928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.646734:0:16494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699404544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789575753.646765:0:15386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bc927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876505699404928:12345-0@lo:400:kworker.0 Request processed in 319us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575753.646772:0:15386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789575753.646812:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:75adfecc-338c-4204-8932-8d3be75fd826:3308:1876505699404416:0@lo:400:kworker.0 00000100:00100000:1.0:1789575753.646828:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876505699404928:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.646857:0:16494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699404544:12345-0@lo:400:kworker.0 Request processed in 125us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575753.646865:0:16494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789575753.646886:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789575753.646891:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789575753.646906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699404672:0@lo:400:kworker.0 00000100:00100000:0.0:1789575753.646962:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404288 00000100:00100000:0.0:1789575753.646967:0:14989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404288 00000100:00100000:0.0:1789575753.647007:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789575753.647018:0:14989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699404288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789575753.647047:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789575753.647069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789575753.647102:0:14989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876505699404288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (6199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575753.647103:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789575753.647110:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789575753.647123:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e958661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699404800:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.647156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789575753.647185:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789575753.647201:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404672 00000100:00100000:3.0:1789575753.647206:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404672 00000100:00100000:3.0:1789575753.647231:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699404800 00000100:00100000:3.0:1789575753.647234:0:14302:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699404800 00000100:00100000:3.0:1789575753.647260:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789575753.647267:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699404672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.647304:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9586618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876505699404672:12345-0@lo:400:kworker.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575753.647311:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789575753.647325:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789575753.647629:0:14302:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e958661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699404800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.647670:0:14302:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e958661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876505699404800:12345-0@lo:400:kworker.0 Request processed in 339us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789575753.647678:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789575753.647702:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789575753.647725:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876505699404800:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.647735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876505699404672:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.647890:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789575753.647896:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e96913fb800, transno 8589934595 00000004:00080000:3.0:1789575753.647909:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789575753.648061:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e958661a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699404544:0@lo:400:kworker.0 00000100:00100000:3.0:1789575753.656234:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876505699404288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789575753.897273:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789575754.445596:0:16572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789575754.920740:0:14288:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789575755.944806:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789575756.200685:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699405056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789575756.200763:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789575756.200814:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876505699405056 00000100:00100000:1.0:1789575756.200824:0:14989:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876505699405056 00000100:00100000:1.0:1789575756.200934:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789575756.200947:0:14989:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699405056:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789575756.200957:0:14296:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789575756.200998:0:14989:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1789575756.201060:0:14989:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e96bbca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876505699405056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789575756.201068:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789575756.201201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e9586619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876505699405056:0@lo:13:osp-pre-0-0.0 Debug log: 30250 lines, 30250 kept, 0 dropped, 0 bad.